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ABSTRACT 


Enhanced solution techniques are developed for solving integer programs (IPs) and 
mixed-integer programs (MIPs). Previously unsolvable problems can be solved with these 
new techniques. We develop knapsack cut-finding procedures for minimal cover cuts, and 
convert existing cut-strengthening theory into practical procedures that lift and tighten vio- 
lated minimal cover valid inequalities to violated knapsack facets in polynomial time. We 
find a new class of knapsack cuts called “non-minimal cover cuts” and a method of lift- 
ing them called “deficit lifting.” Deficit lifting enables all of these cuts to be lifted and 
tightened to facets as well. Extensions of these techniques enable us to find cuts for elas- 
tic knapsack constraints and cuts for non-standard knapsack constraints. We also develop 
the new technique of “explicit-constraint branching” (ECB). ECB enables the technique of 
constraint branching to be used on IPs and MIPs that do not have the structure required for 
known “implicit-constraint branching” techniques. When these techniques are applied to 
84 randomly generated generalized assignment problems, the combination of knapsack cuts 
and explicit-constraint branching were able to solve 100% of the problems in under 1000 
CPU seconds. Explicit constraint branching alone solved 94%, and knapsack cuts solved 
93%. Standard branch and bound alone solved only 38%. The benefits of these techniques 
are also demonstrated on some real-world generalized assignment and set-partitioning prob- 


lems. 
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I. INTRODUCTION 


This dissertation develops new solution techniques, and improves existing solution 
techniques for integer programs (IPs) and mixed-integer programs (MIPs). A linear pro- 
gram (LP) minimizes or maximizes a linear objective function subject to linear constraints. 
LPs have continuous variables; restricting some of the variables in an LP to be integer re- 
sults in a MIP; restricting all variables to be integer results in an IP Mixed-integer and 
integer programs are used to model many planning problems of the military and industrial 
world such as production planning, vehicle routing and scheduling, fleet management and 
weapons system procurement. 

In the last few years, commercial solvers have dramatically improved solution times 
for large LPs, but even modest-sized IPs remain difficult to solve. As an example of com- 
parable difficulty, consider one of our test problems (denoted “DLWRD” in Chapter VI) 
which 1s a truck-routing problem in the petroleum industry: This IP has only 89 constraints 
and 469 variables but cannot be solved in less than 1,000 seconds on a fast IBM workstation 
using good, off-the-shelf technology; the corresponding LP (formed by allowing the integer 
variables of the IP to admit continuous solutions) can be solved in a fraction of a second, 
however. This disparity in solution times indicates that additional research on efficiently 
solving IPs and MIPs 1s warranted. 

The solution techniques developed in this dissertation are used to solve certain previ- 
ously unsolved problems. We call the combination of these techniques “composite enumer- 
ation.” Composite enumeration combines constraint-generation and constraint-branching 
techniques within a standard (variable-based) branch-and-bound framework. These tech- 
niques will be described in greater detail later in this chapter. 

Any solution technique for MIPs developed in this dissertation will be valid for 
(pure) IPs as well. The scope of applicability will be clearly stated for each solution tech- 
nique described. To avoid repeating “IPs and MIPs,” subsequent references to “MIPs” will 


mean “IPs and MIPs” unless stated otherwise. 


A. SOLUTION TECHNIQUES FOR MIPs 


i Introduction 


Composite enumeration is the combination of techniques that will be used for solv- 
ing MIPs. It works within the framework of “branch and bound,” one of the two standard 
solution techniques for MIPs, but it also uses the other standard technique, “cutting planes.” 
Cutting planes are constraints that are generated and then added to the original problem 
to help solve it. Understanding these two basic techniques is essential to understanding 
the fundamentals of composite enumeration, so a brief introduction to these techniques is 
given in this section. Readers familiar with branch and bound and cutting planes may wish 
to proceed directly to section C where the specific research areas of this dissertation are 
discussed. 

To begin, we consider the following IP (most of the discussion here is valid for MIPs 
as well as IPs but clarity is enhanced by considering pure [Ps only): 


* 


z* = min cx 
subject to: AX = 9b (1.1) 
On = a ecmtecen 


where A is an m x n matrix and the other vectors are commensurately dimensioned. The 
optimal solution to (1.1) is x*, and z* = cx*. Note that this problem and its LP relaxation 
can never be unbounded since all variables are bounded above and below. Although we 
show (1.1) with equality constraints, constraints with senses of < and > are admitted in [Ps 
as well. If the vector u is a vector of all 1s, then the IP is a binary IP 

Both standard branch-and-bound and cutting-plane solution procedures begin by 
solving the “LP relaxation” of the IP The LP relaxation is simply the IP with the integer 
restriction on the variables relaxed, which allows the variables to take on appropriately 
bounded continuous values. (A precise description appears in Chapter II.) The solution 
to the LP relaxation is used as a starting point for both standard branch-and-bound and 
cutting-plane solution procedures. If the LP solution is integer, the IP has also been solved. 


If not, the LP solution still provides useful information. The LP’s optimal objective function 





Figure 1. The convex hull of integer solutions. 


value is a lower bound on the IP’s optimal objective function value, and it is a reasonable 
assumption (although not always true) that the integer optimal solution will be close to the 
LP solution. 

Before describing branch and bound, cutting planes, and an enhancement to standard 


? 


branch and bound called “constraint branching,” a brief description of the integer polytope 


is included to introduce terminology and concepts referred to later in this chapter. 


Es Description of the Integer Polytope 


The feasible region of an IP 1s a lattice of integer points. The smallest polytope that 
encompasses all feasible points of the IP is called “the convex hull of integer solutions” 
or, simply, “the convex hull.” The convex hull is a polytope with integer vertices at all 
corner points. (See Figure 1.) If the constraint set for this polytope were known for an 
IP an application of the simplex method to the LP relaxation of the IP would lead to an 
optimal integer solution (and thus a solution to the IP), because the simplex method proceeds 
from corner point to corner point, and all corner points of the convex hull are integral. 
The individual constraints that comprise the minimal constraint set of the convex hull are 
referred to as “facets.” The set of facets for an IP is unique (e.g., Nemhauser and Wolsey, 


1988, p.91). 


2 





Figure 2. An enumeration tree. 


3. Branch and Bound 


The following explanation of enumeration trees, branch and bound, and the general 
branch-and-bound algorithm follows Garfinkel and Nemhauser, (1972, pp. 108-118). The 


explanation is in the context of (J.1), a minimization problem. 


a. Enumeration tree 


The branch-and-bound process is best described with an enumeration tree. 
In an enumeration tree, each node v; represents a problem to be solved that relates back 
to the original problem vo. The feasible region of v; is the feasible region of vp with a 
restriction added for each branch in the path P; from vp to v;, Thus, v; is the same as vg 
with n additional restrictions, assuming P; has passed through n — 1 nodes between (and not 
including) vp and v;. Each node has only one immediate predecessor, but may have many 
immediate successors. For example, in Figure 2, v2 has v9 as its immediate predecessor and 
has two immediate successors. The following description is of LP-based branch and bound 
for IPs, but any kind of useful relaxation of an IP may be substituted for the LP relaxation. 

Branch and bound begins at vg by solving the LP relaxation of vp, LP(O). 
If the LP solution is integer, vg is Solved. If not, branch and bound recursively derives sets 
of restrictions from LP solutions that define a set of IPs, v7, vo, ..., vm such that the solution 


to at least one of these IPs solves vo, if a solution exists. Branch and bound evaluates the 


corresponding relaxations LP(1), LP(2),..., LP(m) to obtain lower bounds used to prove 
optimality of the solution obtained, or to prove that no solution exists. 

The process of “evaluation” at v; determines if the solution to v; (if it exists) 
could solve vg. The solution to LP(j) determines whether or not any subsequent IPs can 
be defined that could lead to a better solution than the best integer solution found thus far, 
called the “incumbent.” If no such IPs can be defined, v, is said to be “fathomed.” If these 
IPs can be defined, “branching” occurs from v,. 

Branching from v; defines new IPs that are each a different restriction of v,, 
at least one of which will solve v,, 1f such a solution exists. Of course, an optimal solution 
to v; is a feasible solution to vg. The restrictions that define v,,,v;.,..., v;,, are derived from 
the solution to LP(j). These nodes are the immediate successors of v;. 

“Node selection” at v; determines the next node to be evaluated. At v;, a 
node must be selected either (a) after the immediate successors of v,; are defined, or (b) 
when v, 1s fathomed. If branching has occurred from v;, one of v;’s immediate successors 
is normally selected. If v; has been fathomed, any other node that has not been fathomed 
or branched from is selected. Such nodes are said to be “live.” Selected nodes must be 
evaluated, and the process repeats. 

v; 1S fathomed when it is determined that branching from v; will not lead to 
an optimal solution for vg or no improvement on the incumbent can be obtained. The three 
cases for which v; 1s fathomed are: 

(1) LP(j) is infeasible. If LP(7) is infeasible, then v; is infeasible. 

(2) The solution to LP(7) is integer. If the solution of LP(7) is integer, then 
any integer solution found by further branching can have no better objective function value 
than that found at v;. (The incumbent’s objective function value, UBo, is an upper bound 
on z*. Any subsequent integer solution with a lower objective function value than UBo 
becomes the incumbent, and UB is updated.) 

(3) The objective function value of LP(7) is greater than or equal to UBo. If 
the objective function value of LP(j) is greater than or equal to UBo, any integer solution 
found by branching from v; would have an objective function value greater than (worse 


than) UBo. 


We examine the branching process next. We consider the problem (1.1), 


which is rewritten as 
z~=mincx st.xéEX, 


where 


X ={x|Ax—b, 0 == aeeimeper, 


If we are attempting to find an x € X that minimizes z*, v; restricts x to X;C X. The set 
X, 1s defined as 
X j= {xlA’x = b?. Ox Sux integer } 

where A’x = b? is the original constraint set plus, usually, some additional constraints. 
When branching from a node, the process of “separation” determines which restrictions 
are applied to /P(j) to form the IPs represented by the immediate successors of v;. To view 
how separation might be achieved at v;, suppose information from the solution to LP(7) 
suggests that z} ~ |%]|. We consider the restrictions 0 < 2; < |¥| or |#/+1< a < 


u;, and form a set 7, consisting of two subsets of 


= x|A’x = b?,0 <x 0 | = | ao integer} 
= %x/A7x =b2,0<x<u,x integer | 
and | 
ee = x|A’x = hone & ue | | ae eS integer } 


x|A??x =b? 0<x<u,x integer | 


so that X;, U X,;,= X,. In this case, as for most IPs, 1; is a partition of X;, but a strict 
partition is not necessary for the branch-and-bound process to converge (e.g., Garfinkel and 
Nemhauser, 1972, p.113). Although binary partitioning has been described here, partition- 
ing (and any other separation) can allow nodes to have more than two immediate successors. 

We have described the foundations of branch and bound and now provide 


the details of the complete branch-and-bound algorithm. The problem considered is 


z = Mines eS (ie) 


Let 


oa Cx; if x; = x solves (I.2) 
J CO if X, =). 


At each node v,, the restricted problem is 


z;=mincx s.t.x € Xj. (1.3) 


A lower bound LB; < z; may be calculated by considering some relaxation of (I.3) 


z;=minex s.t.x € Rj;D X; (1.4) 


and letting 
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ee ae if x? = x solves (1.4) 
ge 0 | ifR, = 0. 


An initial upper bound UB can be calculated by finding any x’€ X, and letting UBy = 
cx’. Otherwise, UBo is initialized to co. The feasible regions considered for the LP-based 


branch-and-bound algorithm are 
De=aiix = b, 0 < x = ux integer), 


Xj = {xlA’x =b?,0<x<u,x integer \ 
and 


Rj= {xlA’x ab Oe ul. 


b. A general branch-and-bound algorithm 


The following algorithm demonstrates branch and bound for an IP: 


Branch-and-Bound Algorithm for IPs 


e Input: An IP vp (z* = min cx s.t.x € Xo) where 
Ap = {x|A°x =b?0<x<u,x integer } . 
e Output: An optimal solution x* to vo, or a message that no solution exists. 


e STEP 1: (Initialization.) Let L = {vg} be the initial list of live nodes. 
vee UBo = ©, LBo = —-OoO, and a v0; 7 = 0. Go to's PEP 2. 


e STEP 2: (Evaluation.) Solve LP(j7). If R; = 0 (.e., LP(7) is infeasible), v, is 
fathomed (case 1) and L = L — {v;}, go to STEP 6. If ZP(j) has an optimal 
solution x, let LB; = z} and go to STEP 3. 


e STEP 3: (Fathoming, case 2.) Ifxf¢ Xj (1.€., x? is not integer), go to STEP 4. 
Ifxfe Gas let UB; = Za VU; is fathomed and L = L — One If UB; < UBo, let 
UBo = UB; and let x’ = x°, where x’ is the incumbent. Go to STEP 6. 


e STEP 4: (Fathoming, case 3.) If LB; > UBo, v; is fathomed and L = L — {v,}. 
Go to STEP 6. Otherwise, go to STEP 5. 


e STEP 5: (Branching.) Choose a separation (partition) 7,;, that determines the 
immediate successors of v;, {v;,, U5, ---, Vj, }. Update the set of live nodes L = 
L—{vu;} piped, - 07,3) Colon Deno 


e STEP 6: (Node selection.) If LZ = 0, go to STEP 7. Otherwise, select a live 
node and designate it v;. Go to STEP 2. 


e STEP 7: (Termination.) If UBp = oo, print “The IP has no feasible solution.” 
If UBo < oo, the feasible solution that yielded UB is optimal, print the optimal 
solution x* = x’. 


c. An example of branching on variables 


The following is an example of branch and bound for an IP where the parti- 
tioning is achieved by “branching on variables.” This technique uses bounds on variables 
to partition the feasible region of the IP and its LP relaxation, and is the most common 


technique used to solve IPs. The solution vector for LP(7) is denoted x? = [&,, 2, 73}. 


Consider the following problem: 


Uo: 2% = minimize 52,+ 1279+ 323 
subject to: 427, + 629+ 23 > 17 (1.5) 
Ly € One eg — Nae 


The LP relaxation of the problem is 


LP(0): z28= minimize 52,+122r9+ 323 
subject to: 47, + 6209+ 243 > 17 (1.6) 
0 < L 5 < LS ee 
The solution to LP(0) is x§ = [2, 15, 0], z§ =LBo = 28. Because 7» is fractional, and 
LBo < UBp, a partition of Xo is chosen that eliminates the current fractional value of Zo. 


The IP at each successor node 1s w restricted by either 
So Oke — 2. 


Adding the restriction x2 < 1 to up forms v,, and adding the restriction rz > 2 to uo forms 
vo. Both nodes are live, and we arbitrarily select v, for evaluation. Attempting to solve the 


LP relaxation of v, 


LP(1): z?= minimize 52, + 1222+ 323 


subjectto: 427,;+ 679+ 23 > 17 (1.7) 
oy) = l | 
Os 2; < 2,5=1,2,3, 


we find the feasible region of LP(1) is empty because forcing x2 < 1 makes it impossible 
to satisfy the first constraint. Thus, v, 1s fathomed (case 1). Since v2 1s still live, we select 


it for evaluation and solve 


LP(2): 28 = minimize 62,+ 1229+ 323 


subject to: 427,;+ 6279+ 243 > 17 
(1.8) 
x9 re 
es; = 2 ale 
The solution to LP(2) is x3 = [14, 2, 0], 22 =LB2 = 304. Because 7, is fractional, 


and LBy < UBo,a partition of Xz is chosen to eliminate the current fractional value of 7}. 






FATHOMED: 
INFEASIBLE 


FATHOMED: FATHOMED: 
INTEGER EXCEEDED 


UPPER BOUN 


Figure 3. The enumeration tree for the branch-and-bound example. 


The IP at each successor node is v2 restricted by either 
07 SOR 2 ea 


Adding the restriction x; < 1 to v2 forms v3, and adding the restriction x; > 2 to vo forms 


v4. Both nodes are live, and we arbitrarily select v3 for evaluation. The LP relaxation is 


EP(3): 28 = minimize 52, + 12%9+ 323 


subject to: 4x, a 629 + 23 > Ly 
LY = il 
0 = Ly < oe) — 1, Doo 


The solution to LP(3) is x3 = [1, 2, 1], 23 =w1B3 = 32. Because x2 is integer, U By aa 
and since UBy = min {00, 32}, UBg is set to 32 and x’ = x3, and 1 is fathomed (case 2). 


The remaining live node vy 1s selected for evaluation. The LP relaxation 1s 


LP(4); 27 = minimze or 127573 


subject to: 42, + 629+ 23 > 17 
Z a Z 
0 = L 3 i Wo) = i 2s 


The solution to LP(4) is x9 = [2, 2, 0], 27 = LB, = 34. Because xq is imteser sees 
34, and UB, is compared with UBo, which is 32. Since UB, > UBy, UBo remains the 


same. Because LB, > UBo, v4 18 fathomed (case 3). Since all nodes are now fathomed 
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(see Figure 3), the integer solution with the lowest objective function value is the optimal 
solution to vp. For this problem, the optimal solution was found at v3 with z* = z3 = 32 
pape oe || 2 

When branch and bound 1s used on large problems, the usual goal is to obtain 
an integer solution with an objective function value that is “close enough” to optimality. 
The use of an “optimality tolerance” precludes branching to find a solution that could only 
be marginally better than the incumbent, if such a solution exists. The absolute optimality 
tolerance is avalue ABSGAP > 0 specified by the user, and a node is fathomed when it is 


guaranteed that 
UBy — LB; < ABSGAP. 


Implementing this amended fathoming rule in the Branch-and-Bound Algorithm for IPs is 


accomplished by replacing step 4 with: 


e STEP 4’: (Fathoming, case 3.) Any node j such that LB;+ ABSGAP > UB gis 
fathomed, go to STEP 6. Otherwise, go to STEP 5. 


Solving an IP using this fathoming rule will result in a solution that is guaranteed to be 
within ABSGAP of the best solution of the problem that could theoretically exist. 
The relative optimality tolerance is a user-specified percentage RELGAP 


> 0; and a node is fathomed when it is guaranteed that 
(UBo = PBA LB | a €) < RELGAP /100 


where € > 0. Note that if LB; and UBo have different signs, this procedure will not work. 
Assuming that 1B; and UByg have the same signs, this amended fathoming rule can be ac- 


complished by replacing step 4 with: 


e STEP 4”: (Fathoming, case 3.) Any node 7 such that (UB) — LB;)/(|ZB,;|+ €) 
< RELGAP /100 is fathomed, go to STEP 6. Otherwise, go to STEP 5. 


Solving an IP using this fathoming rule will result in a solution that is guaranteed to be 
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Figure 4. Adding a cutting plane to the constraint set of an IP. 


within RELGAP percent of the best solution of the problem that could theoretically exist. 
(A slight error due to € is possible, actually.) 

Branch and bound has been the standard way to solve integer programs since 
the early 1960s, and 1s credited to Land and Doig (1960). For simplicity, this technique has 


been demonstrated with an IP but this process is also applicable to MIPs. 


4. Cutting Planes 


This discussion focuses on IPs for simplicity, but cutting planes are also used with 
MIPs. 

The cutting-plane technique, more commonly referred to today as “constraint gen- 
eration,” generates additional constraints (cuts) that are appended to the constraint set of 
the original problem. These constraints must meet two criteria: (a) They must be “valid 1n- 
equalities” that do not eliminate any of the feasible solutions to the IP when added to the 
problem, and (b) they must cut away the current fractional (I[P-infeasible) solution to the 
LP relaxation. (See Figure 4.) The goal of a cutting-plane technique is to iteratively cut 


away fractional solutions to the LP relaxations until the optimal solution to the IP is found 
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by solving the LP relaxation. 

Cutting-plane techniques fall into two general categories, techniques that depend 
on special structure in the problem (“structure-dependent techniques”), and techniques that 
can be applied to any IP, independent of the problem structure (“structure-independent tech- 
niques’ ). 

Examples of structure-dependent techniques include methods for generating valid- 
inequalities from the set packing polytope (Padberg, 1973), from the knapsack polytope 
(Padberg 1975), and from the set covering polytope (Cornugjols and Sassano, 1989). Struc- 
ture-dependent techniques are relatively easy to implement, but usually cannot guarantee 
convergence of the cutting-plane technique because they do not derive cuts from the prob- 
lem’s complete constraint set. This dissertation uses cuts derived from the knapsack poly- 
tope because knapsack constraints frequently appear in IPs and are fairly easy to find and 
exploit. 

Structure-independent cutting-plane techniques include Gomory cuts (Gomory, 
1958), Dantzig cuts (Dantzig, 1959) and the Chvatal-Gomory rounding method (Chva- 
tal,1973). Many of these techniques have finite (convergent) algorithms associated with 
them. Although initial computational experience with structure-independent techniques 
was disappointing, more recent research on lift-and-project cuts (Balas, Ceria, and Cor- 
nugjols, 1993) and Chvatal-Gomory cuts (Caprara and Fischetti, 1996) has been more suc- 
cessful. Our initial experience with a structure-independent cutting-plane technique was 
disappointing, as the computational overhead proved to be significant. Because of this, this 
dissertation does not consider structure-independent constraint-generation techniques for 
composite enumeration. This is an area for future research. 

On large problems, cutting planes alone have not usually been successful in ob- 
taining integer solutions, but the combination of cutting planes with other techniques con- 
tinues to produce new solution methodologies for MIPs. Crowder, et al. (1983) combine 
preprocessing, cutting planes, and a modification of branch and bound to solve large binary 
IPs. Johnson, et al. (1985) combine preprocessing, coefficient reduction, cutting planes and 
a modification of branch and bound to solve large-scale binary planning models. 


Another combination of techniques called “branch and cut” adds cuts during the 


branch-and-bound process. It has been used successfully to solve large MIPs with special 
structure (Padberg and Rinaldi, 1991, Hoffman and Padberg, 1991, 1993, Balas, Ceria, and 
Comueéjols, 1996). The cuts are generated from the solution of an LP at a node within the 
branch-and-bound enumeration tree. These cuts can be either “globally valid” or “locally 
valid.” Globally valid cuts, such as the polyhedral cuts used by Hoffman and Padberg 
(1993), are cuts that are valid for any node in the enumeration tree. Locally valid cuts 
are cuts generated from the restricted LP at a particular node that are only valid for that 
node and any of its successors. Gomory cuts and knapsack cuts are examples of cuts that 
are locally valid when generated from the restricted LPs. The knapsack cuts developed in 
this dissertation could be used in a branch-and-cut framework, but we leave this for future 
research. We only apply knapsack cuts before the start of branch and bound, where they are 


globally valid. 


Example 1. This example demonstrates a simple cutting-plane technique for MIPs with 
“knapsack constraints.” A pure IP 1s used for illustration here, but the technique 1s equally 
valid for MIPs containing binary knapsack constraints. This technique is formalized in 
Chapter III, and is the primary cutting-plane technique used in this dissertation. The solution 
vector for LP(j) is denoted x? = [v1, £2, 43, x4], and z? is the objective function value 
for LP(j). 


Consider the problem: 
2g = maximize Oe, 12795 ora 
subjectto: 32, + 429+ 7r3+24 < 12 (1.11) 
Ce Ce Jo 


This problem is a binary “knapsack problem” (e.g., Garfinkel and Nemhauser, 1972, pp. 13- 
14). The solution to the LP relaxation of (LI))isi2e—=sije = 2, a 


z§ = 322. By considering the knapsack constraint 
32, +429 + 773 + 24 < 12, (1.12) 


and the LP solution of (I.11), it 1s clear that the three variables that were positive in the 


solution to the LP relaxation cannot all be set to 1, since this would violate (1.12). An 
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inequality that expresses this statement is 
L1,+X9+ 23 < 2. (J.13) 


Because this inequality does not eliminate any valid solutions to (J.11), it is a “valid in- 
equality” for the IP Because 

Ty +to+73 > 2, 
the valid inequality (1.13) 1s violated by the fractional solution to the LP relaxation, so (1.13) 


is also a “cut.” By appending ([.13) to (1.11), a new IP is formed: 


zy = maximize 102,+ 1275+ 1573+ 2, 
Subjectto: 32,;+ 420+ 7x3+244 < 12 114 
Xi, + rot 23 ce 2 . ) 
‘= 


0) i) 9 


ay 


The solution to the first LP relaxation, z; = 1, ro = 1, 3 = 2. Z4 = O, has been cut off by 


2 
the cutting plane 7; + 72+ 23 < 2, and 1s now infeasible to the LP relaxation of (1.14). The 
solution to the LP relaxation of (I.14) is an integer solutionz; = 0, 72 = 1, 73 = 1, 4 = 1, 
zy? = zj] = 28, and the problem 1s solved. 


End example 1. 


Ds Constraint Branching 


Since its inception, there has been a quest to improve the process of branch and 
bound. Branch-and-cut techniques seek to improve the process by using cutting planes. 
Constraint branching takes a different approach. First, consider variable-based branch and 
bound for MIPs. It partitions the feasible region of the MIP by branching on single integer 
variables. For instance, if 

ee ei 


for some integer /, the branching choices are 
ti eOne eek 1. 


This often creates an unbalanced enumeration tree, especially in the case of binary variables. 


ite 


(We explain the concept of “balance” in the next section.) If we could discover a bounded 


relationship involving a set of variables, such as 
k<)  ajz; <k+1, 
3 


where all a; as well as & are integer, we could partition the IP’s feasible region with re- 
spect to the entire expression )) a,;x;. This technique has the potential to create a bet- 
ter balanced enumeration tree. aie choice for “constraint branching” might consider the 
branching choices 

se a,x; < kor 3 5 eaten 
Certain applications of this recumrante have arcuer to be much more effective than variable- 
based branch and bound for problems with special structure. 

Beale and Tomlin (1973) developed the first application of constraint branching 
using “special ordered sets.” Special ordered sets (SOS) are sets of variables within ex- 
isting constraints that share a common property. For example, the set of variables in a 
set-partitioning constraint (5° z; = 1, x; binary for all 7 € J;) share the Type 1 SOS 
property that at most one of the variables in the set can be non-zero. Partitioning with SOS 
is achieved using the solution values from the LP relaxation and the user-implied ordering 
of the variables. This information is used to define subsets of the variables that determine 
the restrictions for each new IP formed. The actual restriction is accomplished logically, 
without adding any new constraints to the MIPs formed at the subsequent nodes. SOS is 
discussed in more detail in the next section. 

The “implicit-constraint-branching” approach of SOS 1s an efficient technique, since 
explicitly adding constraints and/or variables to a problem can make the problem more com- 
putationally difficult. Although Beale and Tomlin recognized two special ordered sets, most 
MIP solution software packages today also include a third type of special ordered set (e.g., 
CPLEX, 1993, pp.71-73). Foster and Ryan (1981) recognize a relationship between sets 
of variables in overlapping set-partitioning constraints and develop an implicit-constraint- 
branching technique for problems with this property. 


One limitation of implicit-constraint branching is that it can only be used when 


16 


Special structure exists somewhere in a MIP. Adding additional structure to a MIP allows 
another type of constraint branching called “explicit-constraint branching” (suggested by 
Wood, 1994) that has proven useful for certain classes of problems. This technique adds 
structure, constraints and variables, to facilitate the branch-and-bound process. Our results 
in Chapter VI show that the increased difficulty resulting from the added structure is often 
outweighed by a reduction in the size of the enumeration tree. This technique is outlined in 


section C.3. 


a. Implicit-constraint branching 


To illustrate why constraint branching might be preferred to variable branch- 
ing, we discuss an example of implicit-constraint branching with SOS variables. 


Assume a MIP. up, has q “set-partitioning constraints” of the form 


ee = 1. 


j€ J; 
where the z,; are binary variables, J is the set of all variables in the problem, J; C J, 
andi = 1,...,q. We are at vg of the branch-and-bound tree, and have solved the LP relax- 
ation of vg, LP(0). Each set of variables z;, 7 € J;, i = 1,...,q is an example of an SOS 
of “Type 1,” which is a set of variables of which at most one variable may be non-zero 
(e.g., CPLEX, 1993, p.72). We first examine the values of the variables in the solution to 
LP(O). If all integer variables have integer values, vo 1s solved. Suppose not, and suppose 
that set-partitioning constraint p has “fractional variables,” 1.e., variables with fractional 
LP solution values. The set of variables J, in the constraint is then partitioned into two 
disjoint subsets, os and ee each containing one or more fractional variables. (The user- 
specified ordering of the variables also influences the composition of the subsets.) vo will 


be restricted by either 


ss x;=lor pe I 


jeJpe? jeJk 


Ve 





Figure 5. Implicit-constraint branching. Partitioning at v2 is achieved by forming two disjoint subsets J and ie such 
thats. = ee 


Those restrictions are equivalent to 


» 4500 SY B50 (1.15) 


je jeJpt 


Instead of adding the appropriate constraint to vg, implicit-constraint branching is carried 
out logically. If from vp we select v1, the first restriction in (1.15) is implicitly added to vo 
by setting x; = 0 forall j € Jf. If we select vo, the second restriction in (1.15) is implicitly 
added to vo by setting xz; = 0 for allj € ie Because no constraints are actually added 
to the problem, this is an implicit-constraint-branching technique. (See Figure 5.) 
Intuitively, this constraint-branching procedure is preferred to variable-based branch 
and bound because it eliminates the unbalanced decisions that are made by branching on 
single binary variables. The variable-based branch-and-bound algorithm must choose a 
variable to branch on. Setting the variable to 0 is a weak decision, since all the variables in 
a set-partitioning constraint except one are set to 0 in the final solution anyway. Setting a 
variable to 1 is a strong decision, because it forces all other variables in the constraint to be 
Set to 0. 
The SOS technique makes a choice that moderates the “strength” of the 
decision made. Branching to a subsequent node restricts all the variables in one subset to 0, 


and allows any combination of the variables in the other subset to sum to 1. As the branching 
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progresses, the “strong” decision of setting a particular variable to one is delayed, while 
unpromising variables are culled out of the unrestricted “sum to 1” subset and placed in the 
new “set to 0” subset. Once an integer solution is found, other partitions are explored using 
different subsets, and the process progresses in the same manner. Favorable computational 
results using SOS are reported by Crowder, et al. (1983) and Hummeltenberg (1984). 

We call any enumeration technique for [Ps that partitions the feasible region 
sufficiently to guarantee convergence a “complete” enumeration technique. SOS Type 1 is 
an example of a complete enumeration technique when all variables fall into at least one 
set-partitioning constraint. Enumeration techniques that cannot guarantee convergence are 
called “incomplete.” Our basic explicit-constraint-branching technique (outlined in section 
C.3) is an example of an incomplete enumeration technique: It must revert to variable-based 


branch and bound on the problem’s original variables to guarantee convergence. 


b. Generalized branching 


“Generalized branching” is a relatively new term. In a generic context, it 
refers to all branching techniques other than standard variable-based branch and bound. 
Techniques such as implicit-constraint branching, our explicit-constraint branching, and 
some branch-and-price techniques (e.g., Sol, 1994) are generalized branching techniques. 
J6rnsten and Larsson (1988) develop a technique they call “generalized branching” which, 
as described in Jérnsten and Varbrand (1991), adds branching constraints at nodes of the 


branch and bound process. 


B. ORGANIZATION 


This dissertation is organized as follows: 


e The remaining sections of this chapter summarize the key results developed in 
this dissertation. These results include computationally efficient procedures for 
deriving a violated knapsack facet from an individual knapsack constraint, a new 
class of knapsack cuts, and a new branching technique called “explicit-constraint 
branching” that improves branch-and-bound performance. 


e Chapter II provides definitions and other preliminary material. 


ie 


Chapter [II develops two cut-generation techniques for standard knapsack con- 
straints, lifting and tight: sing techniques that guarantee the creation of stronger 
cuts from those originali, generated, and a new class of knapsack cuts. 


Chapter IV develops a cut-generation technique for elastic knapsack constraints 
and transformations that allow cut generation for non-standard knapsack con- 
straints. 


Chapter V develops the technique of explicit-constraint branching. 


Chapter VI outlines results of composite enumeration as applied to a series of test 
problems including modified and standard Generalized Assignment Problems 
(GAPs). 


Chapter VII summarizes completed research. 


ENHANCED SOLUTION TECHNIQUES FOR MIPs 


1. 


Introduction 


We will show that combining cutting planes derived from individual knapsack con- 
straints with an explicit-constraint branching technique (discussed in section C.3) produces 
remarkable computational results. While knapsack cuts alone rarely solve previously un- 
solvable MIPs, our research shows that the combination of knapsack cuts with explicit- 
constraint branching solves MIPs that cannot be solved in a practical amount of computing 
time by either of the two techniques applied in isolation. The use of knapsack cuts makes 
intuitive sense, and they are easy to exploit. The knapsack structure is commonly found 1n 


many real-world problems. 


Cutting Planes from the 0-1 Knapsack Polytope 


a. Knapsack facets 


A constraint of the form 


Ss CED: 


j€d, 
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where a; and 6 are positive integers, x; are binary variables, and J; C J is commonly re- 
ferred to as a “knapsack constraint.” Knapsack constraints are often used to model con- 
sumption of limited resources, where b represents the amount of resource available and 
a; represents the amount of resource that will be consumed if the variable representing a 
resource-consuming process z; 1s activated by setting z; = 1. 

One of the key results of this dissertation is a cutting-plane technique for a 
knapsack constraint that finds a maximally violated “minimal cover cut,” (e.g., Balas and 
Zemel, 1978) if one exists, and then lifts and tightens the cut to a facet of the knapsack 
polytope, all in pseudo-polynomial time. We first require a feasible solution to the LP 
relaxation of the MIP. To be a candidate for a cutting-plane technique, a knapsack constraint 
must have at least one variable with a fractional LP solution value. For these candidates, we 
find a maximally violated minimal cover cut, if one exists, in pseudo-polynomial time by 
using dynamic programming; this requires that the coefficients and the right-hand side of the 
knapsack constraint be integer. Then, a procedure that combines “lifting” and “tightening” 
creates a facet from the minimal cover cut in polynomial time. The combination of the two 
procedures is a technique that finds a maximally violated facet of the knapsack polytope 
in pseudo-polynomial time. A new cut-finding procedure for a knapsack constraint finds a 
“non-minimal cover cut” if one exists but no minimal cover cut does. A similar lifting and 
tightening procedure creates a knapsack facet from this cut as well. Results are extended 
to elastic knapsack constraints and knapsack constraints with greater-than-or equal-to and 
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equality senses. (Chapter II provides the definitions of “lifting,” “tightening,” “minimal 
cover’ and “minimal cover cut.”) 

As with most cutting-plane techniques that rely on limited special structure, 
these techniques are not convergent. That is, they will not generate cuts that define the 
convex hull of the MIP in enough detail to solve the MIP. This is true because knapsack 
facets are derived from individual knapsack constraints, and thus are facets of the knapsack 
polytope, but are not usually facets of the MIP’s polytope. Nonetheless, these knapsack cuts 
enable other branching techniques to work more quickly and efficiently. Knapsack cuts are 
derived in Chapter III. 

The properties of the knapsack polytope have been explored in the literature 


zal 


for over 20 years. Our research builds on results found in the seminal papers of Padberg, 
Balas, and Zemel. Padberg’s method for lifting a minimal cover valid inequality to a facet 
(1975) is a key result that has laid the groundwork for many other knapsack results. From 
Padberg’s result, Balas (1975) develops necessary and sufficient conditions for classes of 
inequalities to define facets of the knapsack polytope. Balas and Zemel identify the class 
of all facets associated with minimal covers for a knapsack polytope (1978). Padberg’s 
knapsack result is applied to help solve large-scale binary IPs by Crowder, Johnson, and 
Padberg (1983). Zemel (1989) develops a method to lift a minimal cover valid inequality to 
a facet in polynomial time. Research continues today with Boyd’s recent papers on Fenchel 


cutting planes, which are cuts for the knapsack polyhedron (Boyd, 1992, 1994). 


b. Computational complexity 


Any cutting-plane technique developed for use on practical problems must 
be computationally tractable. Computational experience has shown knapsack cuts to be 
useful for reducing variable-based branch and bound enumeration (Crowder et al., 1983), 
but the additional constraints generated must be more useful than the computational over- 
head added by the actual process of generating the cuts. The emphasis on computational 
complexity is demonstrated by the following excerpt from a paper on knapsack cuts: 


...1t 1s not clear that given a minimal cover from which a violated facet can be 
generated by lifting and complementing that such a facet can be generated 
in pseudo-polynomial time (the polynomial time lifting theorem of Zemel 
guarantees a facet, not a violated facet). (Boyd, 1992) 


The lifting and tightening methodology we develop for minimal cover cuts 


lifts and tightens a minimal cover cut to a violated facet in polynomial time. 


c. Cuts for elastic knapsack constraints 


An elastic constraint is a constraint from a MIP that has been transformed by 
the addition of one or more variables that allow penalized violation of the constraint. The 
penalty is applied by adding each elastic variable to the objective function with some coef- 


ficient p that represents the cost per unit of violation. Elastic constraints occur frequently 
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in LPs and MIPs (e.g., Brown and Graves, 1981). While any constraint can be made elas- 
tic, knapsack constraints are prime candidates for “elasticizing.” Consider the knapsack 


constraint 
WE az; < 6. (1.16) 


j€Ed; 
We create an elastic knapsack constraint from (1.16) by adding an elastic variable z > 0: 


S| a;zj—2z <b. 


jEd; 
The variable z represents the additional units of resource that can be used above and beyond 
the basic limit of b if an appropriate (linear) penalty is paid. The variable z may or may not 
be explicitly bounded. 
Our research extends the basic knapsack cut results to derive cuts from elas- 
tic knapsack constraints. This new result (Chapter III) allows the use of knapsack cutting 
planes on the Generalized Generalized Assignment Problem (GGAP), an extension of the 


GAP that uses elastic knapsack constraints. The GGAP is described in Chapter II. 


3: Explicit-Constraint Branching 


“Explicit-constraint branching” (ECB) is a new technique that allows the benefits of 
constraint branching for problems lacking the special structure required of known implicit- 
constraint-branching techniques. This new technique is remarkable because the combina- 
tion of variable-based branch and bound and ECB solves MIPs that variable-based branch 
and bound alone cannot solve. When knapsack cuts are added to this combination, the per- 
formance is often better yet. 

The constraints and general integer variables that ECB adds to a MIP facilitate 
variable-based branch and bound. This may sound counterintuitive, but a simple exam- 
ple illustrates why this technique has merit. 

Example 2. Consider the binary IP (the problem is trivial, but serves to highlight the ben- 


efits of ECB on even small problems) 


maximize ) > 2; 
jeJ 
subject to: }> 22; < 2 | areal 
jeJ 
Lj e {0, 1} Vj Ee J. 


The LP relaxation has an extreme point solution with ke of the variables equal to 1, 


variable equal to .5, and the other | J| — 321] — ] variables equal to 0. Variable-based branch 
and bound forms a partition based on the one fractional variable, which we designate as z,, 
and derives the restrictions 
ps sO aetaale 

Each subsequent LP relaxation solved at a node of the enumeration tree has one of the re- 
maining unfixed variables fractional, until the last variable is fixed by branch and bound, 
and an integer solution is finally obtained. Although this integer solution is an optimal so- 
lution, the bounding information is not sufficient to fathom other live nodes, so another live 
node is selected, and after a similar lengthy path around the enumeration tree fixing frac- 
tional variables at each node, another (alternate) optimal solution is found. This exhaustive 
process continues until all (a p alternate optimal solutions are enumerated. 

We employ constraint branching on this problem to reduce the number of nodes 
branch and bound must enumerate. By adding an additional variable y, called a “branching 
variable,” and a constraint (redundant to the IP) of the form 

ly Ly ee 
jeJ 
we form the modified problem 


maximize ) z; 


jeJ 
Slibjecvwes= > 2a- ee | + 1 
jEJ 
a a 
je J 
I; = {Q, 1} id EJ 
y € {Oe 


The LP relaxation solves exactly as before for the z;, and the branching variable y is equal to 
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zt +.5. The variable-based branch and bound partition based on y derives the restrictions 


ys a OnLy = a steed 


The second restriction is infeasible, and the first yields an LP relaxation with optimal ex- 
treme points. Variable-based branch and bound, using the simplex algorithm to solve the 
LP relaxations, requires only three nodes to solve this problem. 

End Example 2. 


In general, the application of explicit-constraint branching adds a constraint 


Se z;—-y=0 
jeJ’ 
where J. C J, and J is the set of indices of all integer variables of the problem. ECB 
constraints can be added for any set of integer variables of a MIP, but the sets of variables 
used to form ECB constraints must be intelligently chosen if computational improvements 
are to be realized. ECB constraints are discussed in Chapter V. 
The next chapter defines the key terms and introduces the notation that will be used 


throughout the rest of the dissertation. 


Zo 
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il. PRELIMINARIES 


This chapter defines key terms used in subsequent chapters. This chapter also gives 
formulations for the IPs that are used for computational testing of the solution techniques 


developed in the dissertation. 


A. DEFINITIONS 


i. General 


_ The notation in this section follows Balas and Zemel (1978). Most of the definitions 


are standard, but a good reference for them is Nemhauser and Wolsey (1988). 


e The knapsack problem is a binary integer program that maximizes the sum of the 
utility of the items that can be carried in a knapsack with limited carrying capacity. 
For the purpose of illustration, it is assumed that there is a single constraint on 
the total weight that the knapsack can carry. The problem can be formulated as: 


Indices: 
7 € N _ items that can be placed in the in the knapsack. 


Given data: 
c; utility of item 7. 
a; weight of item 7. 
b total weight the knapsack can carry. 
Decision variables: 
x; 1ifitem 7 is placed in the knapsack; 0 otherwise. 


Formulation: 


MjaMiMZe we ac 
jEN 
subjectto: > a;xz; < bd (i) 
jEN 
Li E {0,1} VIEN. 
NOTE: The version of the knapsack problem where the z; are general integer variables 1s 
not considered in this dissertation. 
e The LP relaxation of an integer program /P(0) isan LP LP(0), which is identical 
to IP(0) except that integer variables are replaced with appropriately bounded 
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continuous variables. For example, the LP relaxation of the knapsack problem 
(JI.1) is 
Maximize | ¢,z, 


jEeN 
SUDJECi1OmmD) -a;0, 0am 
jENn 
The knapsack inequality is 
S| aja; <b, (11.2) 
jEN 
where a; and 6 are positive integers, x, are binary variables, and N = {1,..., n}. 


The integer polytope P associated with a general integer program is the convex 
hull of points that satisfy 


P=conv{x€ Z" | Ax <b,Dx=d}, (II.3) 


where Ax < b represents all inequalities, and Dx = d represents all equalities 
in the constraint set of the general IP (see Figure 1). 


The points x?,...,.x* € R” are linearly independent if the unique solution of 
k 4 

» Aix’ = 0182, = 0 fore — eee 

= 


k 


The points x!,...,x* € R” are affinely independent if the unique solution of 


k k 
Oe) >) A: = 0is 1; =O fort =e 


7=1 Il 


The following statements are equivalent: 


a. x!,...,x* € R” are affinely independent. 


b. x* — x!_x3 — x}, ...,x* — x! are linearly independent. 


The dimension of a polytope P is k if the maximum number of affinely indepen- 
dent points in Pisk +1. 


The knapsack polytope P associated with (II.2) 1s the convex hull of 0-1 points 
that satisfy (II.2): 


P= conv > € {0,1}”" S- aot | (II.4) 


jJEN 


(This is just a special case of (JI.3) where the variables are binary and the con- 
straint set consists of one knapsack constraint.) 


Assumption 1: It is assumed that the dimension for the knapsack polytope P is 
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2: 


d = n, which 1s true if and only ifa; < 6,V 7 € N (Balas and Zemel, 1978). 


A facet of the integer polytope P (II.4) is an inequality of the form 
S- wjaz < wo (II.5) 
jEN 


that is satisfied by every x € P, and satisfied at equality by exactly d affinely 
independent points x € P, where d is the dimension of P. 


A valid inequality for an IP is an inequality of the form 
S| wyxj < wo (11.6) 
jESCN 


which, when added to the constraint set of the IP does not exclude any feasible 
solution to the IP 


A cut for an IP is a valid inequality that, when added to the IP eliminates some 
fractional solution x to the LP relaxation of the IP The valid inequality (II.6) is 


also a cut if 

Ss Wily > WO. 

jes 
(Cuts are also referred to as “violated valid inequalities,” where the violation is 
DS W425 = Ww.) 


JES 


Lifting and Tightening Valid Inequalities 


The two processes of lifting and tightening a valid inequality are used throughout 


the literature on constraint generation, but their definitions often differ between papers. For 


the purposes of this dissertation, we will make a clear differentiation between the two terms. 


Lifting is the process of extending a valid inequality for an IP to include as many 
additional variables as possible without eliminating any feasible integer solu- 
tions. Every variable that is added to (lifted into) the valid inequality may enable 
the extended valid inequality to eliminate more of the feasible region associated 
with the LP relaxation of the IP For example, suppose that by some means an 
initial valid inequality 


4, +%79+273< 2 (11.7) 


is obtained for the following knapsack problem: 
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maximize 107, + 1279 + 1573+ 924 
subject to: 37) + 479+ 72r3+10rg < 12 
Li OE {O; 1 eee 


The valid inequality (II.7) indicates that at most two of the variables x;, 7 = 
1,2,3, may be set to 1 without violating the knapsack constraint. One lifting 
process (called “simple lifting” in this dissertation) extends the valid inequality to 
include all variables that have constraint coefficients greater than or equal to the 
largest constraint coefficient of the variables in the valid inequality. Since the co- 
efficient on x4 is greater than the maximum of the coefficients on z;, 7 = 1, 2,3, 
the valid inequality (II.7) may be lifted (extended) by including the variable x, : 


Ly ttot+ rz +74 < 2. 


e The process of tightening a less-than-or-equal-to valid inequality increases the 
coefficients of the variables from their current value to a higher integer value if 
it can be done without eliminating any feasible integer solutions. A continuation 
of the lifting example demonstrates this, using the valid inequality 


Ly_ttot+r3 +74 < 2. 
If x4 is set to 1, no other variable in the valid inequality can be set to 1 without 


violating the knapsack constraint. Thus, x4 can be assigned a coefficient of 2 
without excluding any valid solutions, and the tightened valid inequality is 


Ly tLo +73 4+ 2x4 < 2. 


3. Covers and Cover Cuts 


All definitions in this section refer to the knapsack inequality (II.2) and the assoc1- 
ated knapsack polytope P (II.4). 
e Acover isaset S C N such that 


ee 


JES 
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A minimal cover S is acover such that 
S- a;<b, VieS. 
jeS—{i} 


A minimal cover valid inequality is a valid inequality that corresponds to the 
minimal cover S : 


ee = (S| |. (II.8) 


jes 
The extension of S (to N) is defined as E(S) = SU S, where 


Sete eme Ss lave a, 77 € S}. 


An extended minimal cover valid inequality is a valid inequality that corresponds 
to extension of S : 
S > 2; <(S|-1. 
j€E(S) 
A minimal cover cut is a minimal cover valid inequality for which 
S 2; >|S|-1 (11.9) 
j€S 


where 7; is the jth component of x, the solution vector of the LP relaxation of 
the MIP. 


A lifted minimal cover cut is a minimal cover valid inequality for the minimal 
cover S extended from (II.9) for which 


Ss” oa S| =) 1). 


jEE(S) 


A strong cover S’ is a minimal cover for which either 


ES) =v 

or 

SS a; + Cee < b 

jES'—{jmax} 

where 

Jmax =argmax a, 

veo) 

and 


a; = max a 
een E(S)) 


3] 


e A tight strong cover is a strong cover S’ such that 
ay — b= ly 
jes! 


e A strong cover valid inequality 1s a minimal cover valid inequality (II.8) based 
on the strong cover S’: 
Ss" [|e 


Jes 
e A strong cover cut is a lifted strong cover valid inequality: 
S) aj <|S'|-1. 
jEE(S") 


Note that the strong cover cut must be a lifted strong cover valid inequality to 
ensure the valid inequality is violated. (This is explained in more detail in Chapter 
ITI.) 


B. TEST PROBLEMS 


This section gives the formulations for the test problems that will be used to evaluate 


the effectiveness of the computational techniques developed in this dissertation. 


1. The Generalized Assignment Problem 


One type of IP used for testing is the Generalized Assignment Problem (GAP). This 
problem arises in a number of contexts (e.g., Amini and Racer 1994, Ross and Soland 1975) 
but is described here as a minimum cost assignment of orders to trucks. Each order must 
be delivered, and the number of orders any truck can deliver is constrained by the amount 
of time the truck has available to make deliveries. It 1s assumed that deliveries are made 
from a single depot and that each order o requires one out-and-back trip of known duration. 
Any order may remain undelivered although a large penalty cost will be incurred if this 
happens. For notational convenience, each non-delivery is modeled as a delivery by a high- 
cost phantom truck ¢ that could deliver all orders by itself. Actual data from the petroleum 


industry and a set of randomly generated GAPs will be used for tests. All data is integer 


a2 


except for costs and penalties. 


Indices: 
o € O 1s the set of orders to be delivered, 
t € T is the set of trucks that can make the deliveries, 


O; is the set of orders that truck ¢ 1s capable of delivering, 
ia is the set of trucks with which order o can be delivered. 
Given data: 


Cot 1S the cost of delivering order o with truck t, and 
hoe are the hours (in tenths) required by truck ¢ to deliver order o, 
H, are the hours (in tenths) available on truck t, Hy = oo. 


Decision variables: 


Zot 1S | if order o is delivered by truck ¢, and is 0 otherwise. 


Formulation: 


mmmimize >») , Corto: 


o€0 tEeT 
subject to: ae = 1 Vo € O (ORDERS) 
teTo 
S- hala < At Vieee (TRUCK-HOURS) 
o€Or 
Tere) Woe G90. t € T,, 
pe The Generalized Generalized Assignment Problem 


This dissertation also considers the generalization of the GAP (GGAP) with elastic 


truck hour constraints. These constraints allow penalized overtime on each truck. 


Indices: Same as GAP 


Given data: Same as GAP with these additions: 
H, 1s the maximum number of regular time hours (in tenths) that truck f may operate, 
H® is the maximum number of overtime hours (in tenths) that truck f may operate, 


Decision variables: Same as GAP with these additions: 


y; overtime hours (in tenths) for truck r 


a4 
2 


Formulation: 


minimize >> >> corto + >. pp2e 


. o€O teT (eT 
subject to: ea ae 
ten 
Ss hotZot —2i Sear 
o€Or 
= ot = {0, 1} 
gt eg 


vo 
Vt 
Vo 


MO), ane nat 


Tm 1 ihe ah 
HO 8 O 


Note that two-sided elastic constraints can also be used to penalize under-utilization of 


trucks. 
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Hl. KNAPSACK CUTS 


We use knapsack cutting planes in composite enumeration because knapsack con- 
straints occur often in IPs, they are relatively easy to work with, and their valid inequalities 
and cuts have been extensively studied in the literature. Despite extensive study, effec- 
tive and efficient procedures to find and apply knapsack cuts have been lacking. In this 
chapter, we develop new techniques for finding and lifting cuts from individual knapsack 
constraints. We describe an algorithm that finds a maximally violated minimal cover cut 
for a knapsack constraint if such a cut exists, an algorithm that lifts a minimal cover cut 
to a lifted minimal cover cut and we develop a new lifting procedure called “interior lift- 
ing” that lifts a lifted minimal cover cut to a strong cover cut (a lifted strong cover valid 
inequality). We adapt polynomial-time facet-finding algorithms to tighten strong cover cuts 
to violated facets, identifying conditions and creating procedures that streamline the facet- 
finding process. 

We identify a new type of knapsack cut, the “non-minimal cover cut,” a cut that can- 
not be found by solving the traditional minimal cover separation problem (e.g., Crowder, et 
al. 1983). We develop non-minimal cover cut-finding procedures and a new lifting proce- 
dure called “deficit lifting.” Deficit lifting creates a violated extended minimal cover valid 
inequality from a non-minimal cover cut, if necessary. All non-minimal cover cuts can be 
lifted and tightened to facets in polynomial time. The complete procedure of cut-finding, 
lifting and tightening for either a minimal or non-minimal cover cut produces a violated 


facet in pseudo-polynomial time. 


A. FINDING A MINIMAL COVER CUT 


All cutting planes for MIPs must meet two criteria: (a) They must be valid inequali- 
ties that do not eliminate any of the feasible solutions to the MIP when added to the problem, 
and (b) they must cut away x, the current fractional (MIP-infeasible) solution to the LP re- 
laxation. We focus on the minimal cover valid inequality (MCVI) because it has been the 


foundation of many of the important results concerning the knapsack polytope. In particular, 


an MCVI can always be lifted and tightened to a facet of its associated knapsack polytope. 
Because we seek an MCVI that is also a cut, we want a violated MCVI which we call a 
“minimal cover cut” (MCC). Two conditions must be satisfied before attempting to find an 
MCC. First, the solution to the LP relaxation x must be fractional. Second, the knapsack 
constraint that we will generate cuts from must have at least one 7; fractional. If those two 
conditions are met, we attempt to find an MCC for the candidate constraint. Because we 
want any facet generated through our lifting and tightening algorithms to have the largest 
violation possible, we begin the facet-generation process by finding an MCC that is maxi- 
mally violated, and if found, call it a “maximally violated minimal cover cut” (XVMCC). 


We describe the XVMCC-finding problem next, and outline an algorithm for its solution. 


Ie Maximally Violated Minimal Cover Cut-Finding Problem 


We solve the XVMCC-finding problem with dynamic programming, which requires 
that the knapsack constraint have integral data. Before formulating the cut-finding problem, 
we review the pertinent definitions. 

Recall that the knapsack constraint is defined as 

Saja; Sb, (111.1) 
jEN 
where a; and b are positive integers, a; < bV 7 € N, z; are binary variables, and N = 
{1,...,2}. A cover for (III.1) isa set S € N such that 
wa (III.2) 
jeS 
and a minimal cover S is a cover such that 
Sa <b, Vie S. (III.3) 
Ges) 
The MCVI is written as 


leak 


ere, 
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2, Cut-Finding Problem Formulation 


In order to find an XVMCC, we must identify a knapsack constraint of the MIP that 
has at least one variable with a fractional LP solution value z;. Once a suitable constraint 
is found, we solve the following cut-finding problem: 

Indices: 

j €N = {]1,2,3,...n} variable index for the knapsack constraint 
Nt ={j€N |Z; > 0} where x is the solution of the LP relaxation of the MIP 


Given data: 


xz; Value for z; ina solution of the LP relaxation of the MIP 
a; knapsack constraint coefficient of z,; 
b right-hand side of the knapsack constraint 


Decision variables: 


h; 1, 1f 2; 1s placed in the minimal cover inequality; 0 otherwise 
r ageneral integer variable that becomes the nght-hand side of the XVMCC 


Formulation: 
maximize ) > ¢jhj —r (III.4a) 
FENtT 
subject to: $~ ajh; > b+1 (III.4b) 
ENT 
a;h; en nie (III.4c) 
jENT 
ws a (III.4d) 
jeNt+ 
h; e {0,1} Vj ENT 
r € ORG 2te, Nt] — ee 





where @min =Min Gj. 
JE ee oeure 
The following list explains the relationship of the constraints to the minimal cover 
cut that we seek. 


(1) Constraint (III.4b) ensures that the right-hand side of the constraint 1s covered 
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as required by (III.2): 


Ss ajhj; SOt+1 E>) ajh; > 0. 
jeNt jeNt 


(2) Constraint (III.4c) ensures that the cover is minimal as required by (III.3). If the 


right-hand side is no longer covered when the element with the minimum coefficient in the 


cover is removed, it will not be covered if any other a; > amin, 7 € N* is removed: 


Ss Gnic, — Anin < 0S > a;h; < Or Gain 
jEN+ jeNt+ 
where Qmin =min a;. Io ensure that all minimal cover cuts are found, we actually solve 
je 
the cut-finding problem |N*| times with each a; = amin, j € N* and requiring h; = 0 for 
every a; < Qmin. (Actually, we need to solve the cut-finding problem only |N*| — p times, 
where| NV *| — p is the number of distinct a;, 7 € N*.) 
(3) Constraint (III.4d) sets the right-hand side r of the prospective cut: 
r=S° hj-1=|S|-1. 
jEN+ 
(4) A violated MCVI has been found if 
SS Zih; —r > 0, 
jEN+ 


where h* and r* solve the cut-finding problem. 


3; Dynamic-Programming Reformulation 


We reformulate the cut-finding problem in order to solve it with dynamic program- 
ming. We can combine (III.4a) and (III.4d) by solving (III.4d) for r, and substituting for r 
in (III.4a). Also, (III.4b) and (III.4c) can be combined into a two-sided constraint. Thus, 


the actual cut-finding problem we solve 1s: 
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maximize > (€;-1)h; 
jEN+ 
subjectto: b+1 < D>) ajh; < bt+amin (III.5) 
jEN+ 
aS {0,1} VI EN, 
where the problem is solved |N*| times with each a; = amin, 7 € N* and requiring 
h; = 0 for every a; < amin. A cut is found if the objective function value is greater than 
—1. Note that this formulation is similar to the constraint identification problem of Crowder 
et al. (1983) except that our requirement for integral data allows us some simplifications. 
The reformulation (III.5) can be solved via this standard dynamic programming re- 


cursion: 
DP Recursion 1 


Initial conditions: 


do(0) = 0 

ane y——comfora’ = 1, ...,0 + dmin 

d;,(a’) = —oo forall k, a’ < 0 
Recursion: 


d;(a’) = max {dp-1(a’), dp 1(a’ ad ar) oo (5 Fa 1)} 


fOme— lev apa = OND + ac: 
The solution to the problem is 


= d oy 
pe ceeen v+|(a ) 
If v* > —1, then an XVMCC has been found, and the corresponding mini- 
mal cover variables and the value of r* can be recovered through auxiliary data structures 


within the dynamic programming algorithm. 


B. LIFTING A MINIMAL COVER CUT TO A STRONG COVER CUT 


In order to obtain a violated facet of the knapsack polytope, we begin with an 
XVMCC, and apply two lifting processes and one of two tightening processes. This section 
describes the two lifting processes which create a strong cover cut from a minimal cover 


CUE. 
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1 Simple Lifting 


Simple lifting adds variables to the original minimal cover cut, possibly enabling 
more IP-infeasible fractional solutions to be eliminated from subsequent solutions of the 
LP relaxation of the MIP The resulting strengthened minimal cover cut is called a “lifted 
minimal cover cut” (LMCC). This lifting process can be performed on any MCVI, and is 
accomplished by forming the extension of the minimal cover S using the following proce- 
dure. The justification follows the procedure statement. (This procedure is very simple, but 


is stated formally for later reference.) 


PROCEDURE I (Simple lifting algorithm): This algorithm takes the coefficients of the 
knapsack constraint with index set N, and the minimal cover S and returns the index set 
E(S), the extension of the minimal cover. 


Input: The index set of the cover S, and the vector of constraint coefficients a;, 7 € N. 


Output: £(S), the extension of the minimal cover S. 


Begin 
Qjmax = nee a 
S= {iE N — Sla; > a,,,} 
E(S)=SUS 
Return £(S) 
End 


Given £(S) from Procedure 1, the LMCC is 
Soe (111.6) 
jEE(S) 
Note that because S C E(S), and the right-hand side of the original MCC is the 
right-hand side of (III.6), 
se a a S| —], 


j€E(S) 
and (III.6) is a cut. 


Justification for Procedure 1: 


For the MCC’s minimal cover S 


eae 


JES 
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Ss” a; 56, Vie € S, 
jES—{Fx} 


S| — 1. 
jes 
If we add any z;, 1 € N —S witha; > Max a3, there still can be no more than |S| — 1 
j 


and the MCC is 


variables x, that can be set to 1, and thus 
ee 1 
j€E(S) 
is also a valid inequality. 


Example 1 (part a): Suppose the solution to the LP relaxation of a MIP with knapsack 


constraint 
4x, + 4%9 + 2734-2274 + 525 + 3276 + 9277 + 3x8 + Brg < 10 


1S 
1 
$y = 5,8) = 1,43 = 1,44 = 1,8, =0V5 > 4. 
The knapsack constraint contains one fractional variable. The solution to (III.5) yields the 


minimal cover S = {1,2,3,4} and the MCC is 
yt +434+ 24 < 3. 


Using input S = {1,2,3,4} and N — S = {5,6,7,8,9}, Procedure 1 computes S = 
{5,7,9} and returns E(S) = SU S = {1, 2,3, 4,5, 7,9}. The initial MCC has now been 
lifted to an LMCC: 

1, +%9+734+%44+754+7%74+ 729 < 3. 


End of Example | (part a) 


Z's Interior Lifting 


The linchpin of our facet-finding process is a procedure we call “interior lifting.” 
Interior lifting, unlike simple lifting, affects the composition of the base cover (the minimal 


cover S found by the XVMCC) because it lifts variables into the LMCC that have constraint 


41 


coefficients smaller thana,;,. = a. At the conclusion of interior lifting, the indices 
corresponding to the |.S| smallest constraint coefficients in the revised LMCC form a strong 
cover S” for the constraint. 

Again, we review some of the key definitions. Recall that a strong cover S’ is a 


minimal cover for which either 


E(S’) —N (III.7) 

or 

» A; + Qimax & 5, (III.8) 

JES!’ —{imax} 

where 

Jmax =Aarg max a; 

jes) 

and 

Oye max Qi. 

ie€N—E(S’) 


Given N, coefficients a;, V 7 € N, a minimal cover S, and E(S), the following in- 


terior lifting procedure creates a strong cover cut from a lifted minimal cover cut. 


PROCEDURE 2 (Interior lifting algorithm): This algorithm takes N, a;, Vj € N,S, 
and E(S) and returns the extension of a strong cover E(S’). 


Input: N,a,;,V 7 € N, S,and £(S). 


Output: £(S’), the extension of a strong cover S’ 


Begin 
50 = Oo: 
E(So) = E(S). 
So = E(So) — So. 
0 


While g < |N — E(So)| - 1 
Jmax =arg Max a; 
7ESg 


a; = max a; 
9  jE€N-—E(S9) 
If aig < b-— Se ay 
JESg—{jmax} 
Go to TERMINATE 


Else 
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Sg+1 a Sg + {ig} — {Jmax} 
Sgo+1 = 9 oe ena 


g=gt+l 
Endif 
Endwhile _ 
TERMINATE: Return E(S") = S,U So. 
End 
Ifana;,,ig € N—E(S) is found such that = — : a a,;, condition (III.8) 
7¢ ep Jmax 
sine, If alla; > b— SS aj;,g =0,1,...,|N — E(So)| — 1, then condition (III.7) 


J€Sg—{Imax} 
is met. In either case, the resulting cover is a strong cover, and the variables corresponding 


to a lifted strong cover valid inequality enable the formation of a strong cover cut 


> 2; <(|S'|-1, (111.9) 


jEE(S") 

where S” is a strong cover. Note that 

ee se! 

jes’ 
is a strong cover valid inequality, but may not be a cut because some or all of the variables 
with positive LP solution values may have been removed from the original minimal cover 
S and placed in S’ of the strong cover. However, because all such variables migrated from 
the original cover into Cas a Se) =o au S’ and since the right-hand side of the valid 


inequality did not change, (III.9) is also violated. 


Theorem 3.1 Let E(S) be the extension of a minimal cover for (III .1) corresponding to 
a minimal cover cut. If S is not strong, successive minimal covers can then be created 
using Procedure 2 that will result in the formation of the extension a strong cover E(S"). 
Furthermore, this extension will correspond to a strong cover cut. (Thus, we start and end 
with a violated valid inequality.) 


Proof. If So = S is not strong, there is some 
SO ea tmax © N- E(So) 


Oy ax 
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such that 


S- Oy Oy ee b 


j€So—{jmax} 
where 
Jmax =arg max a; 
JESOo 
and 
a; max 4; 
ae 1€N—E(So) ‘ 


Recall that E(S9) = So U ct where 
So = {wen — So lowe ve Sole 


Since 


Oj SU os ) Oe, 
j€So—{jmax} 
anew minimal cover Sj 1s created 


Sy = So oa A ene oF te eae : 
A new extension is created 


Sy oa cs U ase 


which is valid because 
Ce a ee oe 


Let S, be the gth minimal cover obtained by applying this procedure iteratively. If 


te ) aj 


JESg—{jmax} 
where 
Jmax =arg max a; 
JESg 
and 
Oy max Qi, 
let 
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eet = ote imax s + 129} 
and 
So+1 = SF U tise ‘ 


The procedure may terminate before examining all of the |NV ~ E(So)| coefficients. 


Suppose at iteration k 


Qi, = b— Qj, 
GES ~—{jmax} 
where 


wt ~ iGN-E (Se) . 
Then, 
S > ay +tai<b Wie N — E(S;), 
JESk—{Jmax} 

condition (III.8) is met, and S’ = S$; is therfore a strong cover. If all |N — E(So)| = p co- 
efficients are lifted in, E(.S,) = N, condition (III.7) is met, and S’ = S, is a strong cover. 
Furthermore, since the index of any variable that leaves the initial minimal cover must be- 
long to the extension of the strong cover, the lifted strong cover valid inequality must be 


violated just as the minimal cover cut is, 1.e., the resulting lifted strong cover valid inequal- 


ity is a strong cover cut for x. OED 


Example 1 (part b) Continuing with Example 1, we now must consider variables in N — 
E(S) (identified below) with coefficients less than a,_,,., where a;,,,. = max a5. ets — 
j 


So. We are considering the constraint 
4c, + 429 + 273 + 2274 + 525 + 3276 + 9x7 + 3x8 + 8rq < 10 


and the cut 


Lr teotrg¢+rygt+xrsgt+47+ 279 < 38, 


45 


where Sp = {1,2,3,4}, So = {5,7,9}, E(So) = SoU So = {1,2,3,4,5,7,9}, 
N — E(So) = {6,8}, and a;,,,, = a1 = 4. (Note: a;_,. = a2 would also be correct.) Since 
| yy a;+ag > 6, condition (III.8) is not met, and Sg is not strong. Applying Procedure 
7 ae formed as 
SS een 
and S is formed as 
S, = 894+ {1}. 
Now we have S, = {2,3, 4,6}, 5: = {1,5, 7,9}, B(S:) = $,US; = {1, 2, 3, 4,5, 6, 7, 9} 
and N — £(S;) = {8}. Since 
Se a; tag < 8, 
jE€S—{jmax} 


511s strong, so S’ = S; . The strong cover cut is 
tyteotagt+ayta5t+rgt+a2z7t zy < 3. (III.10) 


Recall that the initial cut began with variables positive in the solution to the LP relaxation. 
They were 

1 
Z 
Since all variables from the initial cut are in this lifted strong cover valid inequality and the 


Lo = 09 Sala 
right hand side of the cut has remained the same, (IIJ.10) is a cut. 

Note that since ag = ag, we can exchange zg, with zg in (III.10). This new valid 
inequality is still violated, and would lead to a different knapsack facet than the facet we 
find in the next section’s example. 


End Example 1 (part b) 


Cc TIGHTENING A STRONG COVER CUT TO A FACET 


A strong cover cut that is not a facet can be tightened to a violated knapsack facet 
using techniques we develop here. We call the strongest of covers a “tight” cover. A strong 


cover is tightif 5 a;—b = 1. For strong cover cuts with tight covers, the facet coefficients 
jeS! 
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are w; = 1 for alli € S’, and are determined by a simple rule based on the value of a; for 
alli € S$’ = E(S’) — S’. However, for strong cover cuts that are not tight( >> a;-—b> 1), 
}ES! 
determining the facet coefficients w; fori € cS requires a more comply poems The 
algorithm developed by Zemel (1989) allows us to compute the facet coefficients for a 
minimal cover, and we adapt it for use on strong covers that are not tight, allowing us to 
make some simplifications. The recursive procedure we develop can be viewed as a simple 
extension of interior lifting that examines the constraint coefficients a; of the variables with 
indices in S$’ and assigns to each variable the appropriate facet coefficient w;. Thus, we 
have two tightening results based on the “tightness” of the strong cover, i.e., on the value 
of )> a; — b, that tighten strong cover cuts to violated facets of the knapsack polytope. 
jes’ 


1. Tightening Result I 


We would like to be able to directly assign the appropriate facet coefficients based 
on the value of a;, 7 € S'. However, this can only be done when the constraint coefficients 


a; meet certain conditions. We state, without proof, a theorem by Balas: 


Theorem 3.2 (Balas, 1975) Let S = {j1, jo, .--,J\s\} be aminimal cover for (III. 1) ordered 
Bovuala,, <4;,<=...< Geen. be the extension ofS, and Sp = {j\s|-n+1, J\s|—h+2) 
i.e., Sp corresponds to the index set of the h largest coefficients in the ordering of S. Let N 
be partitioned into No, Nj,....Nq q = |S| — 1, where 


No =N- ES) 


N= Se bile) = E(S) — Sla; a aes 


JES2 


= i€ E(S)|>_ a; Sajy< as Qi Pp, ee ee 
jJESp, Je 5,41 
and define 
Te =hV7E N+, fo Ol od: 


So aj+ >> aya} <|S|-1 (111.11) 
jES 


g jJEN-S 
is satisfied by allx € P. Furthermore, if 


Then, the inequality 


i) a7, Vie N;,, h=0,1,...,9, (111.12) 
jeS— 1 
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eo JS{h 


then (IIL. ll) is a facet of P. 


Remark. Condition (III.12) implies that S is a strong cover. 


Note that Balas’ condition (III.12) really imposes a much stronger condition than a 


strong cover. The only requirement for a strong cover is 
Ss A; + Gina, <b 
7 €S'—{jmax} 
where 


Jmax =arg Max a; 
jes! 
and 


Qimax —. Max a 
i€N—E(S’) 
This is equivalent toa; <b-— >> a;,¥2€ No, which is only one of the || conditions 


7ES—S} 
of (III.12). 
Example 2: Given the knapsack constraint 


52, + 529 + 6273 + 6244+ 7x5 + 846 + 9x7 + 10278 < 11 


and a minimal cover S = {1, 2,3}, it is obvious that E(S) = N, and the cover is strong. 
Balas’ theorem places the entire extension in N; = {4, 5,6, 7,8} yet only the coefficient of 


x4 meets condition (III.12). Thus, the valid inequality derived by the theorem, 
ey ate oe gcd iat aaa Giclee ore een 
is not a facet. The facet, which can be derived by Zemel’s algorithm, is 
Ly_teotxrg+44t+ 2e5 + 2764+ 2r7 + 2xg < 2. 


End Example 2 

Because our goal is to derive facets, we state the following corollary to Balas’ the- 
orem, which shows that if S’ is a tight cover (1.e., }) a; — b = 1) Balas’ theorem is 
guaranteed to derive a facet. om 


Corollary 3.3. Jf S' is a tight cover then the inequality (III. ll) created by Balas’ theorem 
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is a facet. 


Proof. If 
>in az — — ie 
jes! 
then 
S- Qs+ SF a; —b= 1 
jeS'-Sh JES). 
or 
ee ay. (111.13) 
JESh4y JES’ Shy 


Balas’ theorem assigns 7; = A for all 7 such that 
pe a, Ve Ny, P= 0,1, ..., 4. (III.14) 
j3ES;, JES 4) 
Because of the integrality requirements for b and all a,, (III.14) can be rewritten as 
> aj Sas DY) aj;-1,Vi € Ny, h=0,1,...,9, 
JES), JESh 41 
which, substituting for the right-hand side using (III.13) yields 
a ee b= S- a;,Wi € Ny, h =0,1,...,9, 
jes), (eso ee 
which are the conditions specified in (III.12). Thus, when 5° a; — b = 1, the coefficients 


jes" 
assigned by Balas’ theorem must meet conditions (III.12), and the derived valid inequality 


(III.11) defines a facet of P. OED 


Note that when the cover is tight, (III.13) allows (III.14) to be rewnitten as 
b — Ss” AG des 0 > ee IN, — Ole. @. 
jes'—S' jes'—Si 


We will use these intervals in the following procedure to assign facet coefficients, but we 


redefine 5° a, as the partial sum A(s — h), the sum of the s — h smallest a;, 7 € S’ 
jeS'—S!, 
VeRO TS eno) a 
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The following procedure applies Corollary 3.3. 


Given a tight strong cover S’, and the partial sums A(z), z = 1,..., s, defined as the 
sum of the t smallest a;, 7 € 5S’, the following algorithm assigns facet coefficients for all 


variables r;,7 € N. 


PROCEDURE 3 (Tightening algorithm I): This algorithm takes a tight strong cover S’ 
and the constraint coefficients in S’ = E(S’) — S’ and returns the facet coefficients w; V 


ers 
Input: S’ = E(S’) — S’ and S’. 
Output: w; for alli € S”. 


Begin s 
Order i € S’ such that a;, < aj, <... < iy 5): 
Order i € S’ such that a;, < aj, <... < Oj gy) 
ACO} 10) 
Compute A(z).2 — 2 oe 
SS |e 
ia 
all _ 
Fon ae 5" 
Ifa; <b-— A(s— (h+1)) 
Wi = A 
Increment k 
Else 
Increment h 
Endif 
Endfor 
End 





s! S|) + OSs 














The complexity of this algorithm is O(|S"| log |S"|) + O(|S’| log 
oO! 
Example 1 (part c) Finishing the problem begun in the first example, we first check 


), which is no worse than O(n log n). 








5S. a; — b. Since 5> a; — 6 = 1, Corollary 3.3 applies, and we assign w,; using Pro- 
Teo jes! 
cedure 3. Recall] that the constraint is 


Ar, +4ro + 273+ 274+ 525 + 326 + 9x7 + 3x8 + 829g < 10, 
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the tight cover is S’ = {2,3, 4,6} , and the strong cover cut is 
Yjyt+2%og+734+%4+2%5+2%6+274+ 4X9 < 3, 


with £(S’) = {1, 2,3, 4, 5,6, 7,9}. We first calculate the set of limits, and the sets defined 


on these limits to assign the appropriate coefficient w, for variable z;: 
N, = {i € E(S") |b-~A(s—h) <a; <b-—A(s—(h+]1))}, he {2,3}. 


Any j € E(S’) such that 6 < a; < 8hasw,; = 2, sowg = 2 and any j € E(S’) such that 
8 <a; < 10 hasw; = 3, sow7 = 3. To determine members of E(S’) that are assigned the 


facet coefficient w; = 1, we use 


N,=S Uf{ie E(S')- S’|a,<b-A(s —2)}. 


Variables x;, 7 € {1,2,3,4,5,6} meet this criterion. The cut is now 
Lyptxtotagt+ayt+rgt+xg t+ 3274+ 229 < 3. 


This valid inequality must be a facet of the polytope of the original knapsack constraint 
because it satisfies the condition in the corollary. Recall again that we began this tightening 
process with a valid inequality which was a strong cover cut. The variables positive in the 


solution to the LP relaxation were 


Teo = eee — | ae I. 


Dol ke 


Since all variables from the strong cover cut are in this facet with facet coefficients w; > 1, 
and the right hand side of the valid inequality is the same as that of the strong cover cut, 


this facet is also a cut because 


Ss t+ Sy Wz, = |.S"| — ]. 


JES’ gS 


End of Example 1 (part c) 


> 


2; Tightening Result II 


If the strong cover is not tight, 1.e., if 


S > a;-b>1, 


jes! 
we cannot assign facet coefficients using Corollary 3.3. The recursive procedure we de- 
velop next, which is similar to Zemel (1989) assigns the appropriate facet coefficients in 
polynomial time. Zemel developed his algorithm to solve Padberg’s series of problems that 


assign facet coefficients. First, we examine Padberg’s result. 


a. Padberg’s result 


A facet-finding result by Padberg (1975) has been the foundation for many 
of the critical discoveries of the knapsack polytope. This result, stated without proof, creates 


a facet of the knapsack polytope by sequentially lifting variables into an MCVI. 


Theorem 3.4 (Padberg 1975). Let S be aminimal cover for (III.1), let N-—S = {%4, ..., tp} 
be arbitrarily ordered, and consider the sequence of knapsack problems 
K S(iz) defined recursively as 


tet 
FOS ip.) Se maximize Lit wy ba 
7ES i=2 
ty 
subjectto: )) aj;z;+ >) ast; < b—ai, 
JES t=s71 
oe, -€ 10,1} sv geese 


i. GS {0,1} Vie N-S 


for k = 1,...,p (where summation over the empty set is 0), with the coefficients 6, defined 
by 


B; — [S| —l- £4; i= oe ee ae 


Then, the inequality 


> a; + ye b.07 = \co— 


JES ieN=S 


is a facet of P. 


52 


The theorem implies that a series of |N — S| IPs (knapsack problems) must 


be solved to determine the coefficients G,,. 


b. Zemel’s result 


Zemel recognized that Padberg’s problem could be solved in a much simpler 
way. First, he recognized that Padberg’s procedure was related to the set of dual knapsack 


problems DKS;(z), z =0,...,s — 1 wheres = |S]. 


k—-1 
WES 7 {2 ) An(z) — iMimmize >) fa,0,1- >, a;r; 


JES i=1} 
ty 
subjectto: >> 2j;+ S> Bz; > 2 
qES i=1} 
z; € {0,1} VjES 
z, € {0,1} VieN-S 


The problem K S(i;) is related to the set of problems DKS; (z), z = 0,..., s — 1 via the re- 


lation 24, — Max {z : Ai, (z) < b— ae : 


ALGORITHM LIFT (Zemel, 1989): This algorithm assigns facet coefficients for all vari- 
ables z;, 7 € N in polynomial time. This algorithm takes a minimal cover S, the partial 
sums £;,t = 1,...,s — 1, defined as follows: 


€; = a;,, where 71 =argmin a, 
jES 
(=o) + a.., where jo =argmin a 
7eS—ay 
€,.1 = ¢s-2+4;,_,, where js_1 = argmin a, 


jES—{ji}—...-{7s-2} 


the right-hand side b and the constraint coefficients in S= E(S) — S and returns the facet 
coefficients G; Vi € S. 


Input: S = E (S) — S (in any sequence) for a minimal cover S, the right-hand side 6, a; V 
i € S, and the partial sums @;, ¢ = 1,...,s — 1. 


Output: 6, forall z € S. 


Begin 
ein Ou—Oan(z) = ¢,.z=1,...,s—1 


For? = i IS 
2; = max 42: Aqiz) <= b—a;} 
B; =s-l- a4 
For’ 2 = 0r-c 
liz 6, A= 
Else Aji1(z) = min { A(z), AhZ — Sie ai} 
Endif 
Endfor 
Endfor 
End 


The facet that corresponds to this algorithm is 
>) 25+ D> Bini < |S] -1. 
Jes ieS 
Note that the facet produced will depend on the order in which the elements of S$ are 
processed. 
In practice, we will apply a variant of Zemel’s algorithm after we have lifted 


to a strong cover cut and determined that the strong cover cut is not tight. Because we begin 


the process with a strong cover cut, the facet we find will be a violated facet. 


c; Tightening Algorithm II 


We will modify Zemel’s algorithm to efficiently tighten strong covers. First, 
by calculating (and updating) one additional sum, we may be able to terminate the algorithm 
after only assigning a few facet coefficients, leaving the others to be assigned by Procedure 
3, a much simpler procedure. The use of this additional sum will also allow us to avoid 


many of the checks min { A;(z), A;(z — @;) + a;} made in Algorithm Lift. 


Lets = |S’ | and detine An (o)i= 2) ear 
jes! 


Corollary 3.5 Jf A;(s) — 6 = 1, then all remaining 5" | — i facet coefficients can be 


assigned using Procedure 3 with the current partial sums A;(z), z = 0,1,..., s. 
Proof. If A;(s) — 6 = 1, we will show that 
A;(z = B;) +a;> A,(z), z= Vee 
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Therefore, the assignment 
Ai4i1(z) = min {A;(z), A;(z — B;) +.4;} 


becomes 
Ajsi(z) = A(z), 


and 








which allows coefficients 
Beh, k = ie eons 5" 


to be assigned using the partial sums 
Aeane? = "lls, 5. 


Suppose A;(s) — 6 = 1, but A,(z — 6,;) + a; < Aj(z) for some z = G,,8; + 1,...,5. We 


know that z; 1s assigned coefficient 6; when 


A,(s -1-—6,;) +a; < band A;(s — 8;) +4; > b. 


Since 
Ai(s — 8;) +a; > b, 
and 
Ai(s) -1=8, 
then 


A;(s = B;) a A,(s) — I, 


and, because of the integrality of the data, 
A;(s a B;) + Q; = A,(s). 
Because of the way the partial sums were formed and updated, we know that 


AS) a A;(s = G;) > Ans - k) a A;(s ree k), eee So = Py; 


55 


and since 
a; 2 Aj\s) = Ais aga 


we know that 
a; > Aj(s —k) =sAy(s— 6, = hk = 1 


Equivalently 
Ai(s — 6 =k) +4, 2 AG 

which is a contradiction. There cannot exist A;(z — 8;) + a; < A;(z) for any z = 1,...,s. 
So, 

Aig (2) = Aig (2) = 2 = A(z) =a ee eee 
and all unassigned facet coefficients can be assigned using Procedure 3 with the current set 
of partial sums A;(z), z = 0,1.,...,s. 
OED 


Corollary 3.6 Jfa; > A;(s)—Aj;(s—8;,), all partial sums used in iterationi+1 will be the 
same as those used in iteration: of Algorithm Lift, that is, Ajs1(z) = A;(z), z = 0,1,..., s. 


Proof. If a; > A;(s) — Ai(s — B;), we will show that 


Aj(z — By) 4G; = Anes — 0, 1S 
Therefore, the assignment 
Aj41(z) = Mitt {A,(z), A,(z ae B;) + a 


becomes 
Ai41(z) = A,(z), Za eee 
Suppose a; > A;(s) — Ai(s — G;), but A;(z — G;) + a; < A;(z). Because of the way the 


partial sums were formed and updated, we know that 
A;(s) =a A,(s ake G:) Zz A;(s ms k) ai A;(s a B; ai kN k a 1, 2D eerste sae B; 


and since 


a; > A,(s) — A,(s = B;), 
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we know that 


Q; > A;(s —k) — Ai(s — B; — k), —— 2 8.8 — 6. 
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Equivalently 

pet eet Oeead (Ss i) kb = 1,2,...— 2. 
which is a contradiction. There cannot exist A;(z — @;) + a; < A;(z) for any z = 1,...,s. 
So. 

Peta — eae Ol... Ss, 

and all partial sums used in iteration 7 + 1 will be the same as those used in iteration 7. 
QED 
Corollary 3.7 Jf the 2;, 7 € Ss are assigned facet coefficients in ascending order of the 
constraint coefficients a;,i € S, the algorithm can be terminated when the first x; receives 


facet coefficient B; = | 8 | + 1, and the remaining z;,1 € S can be directly assigned facet 
coefficients using Procedure 3 with the current partial sums A;(z), z = 0,1,...,s —1— ;. 


Proof. When 6; = |§| + 1, 
S 
A;(s — 1—- (|= aad 1)) < b— Qj. 
The smallest partial sum that can be adjusted is 
Ai+i(8;) = min {A;(6;), Ai(z — B;) + ai}. 


Because of the imposed ordering, a;4; > a;. This means that b — a;,, < b — a;, and thus, 


the largest partial sum smaller than the difference b — a;,, can be no larger than 


5 


Wes 1 (|= | if 1)) mee = => 


Since 
S S 
Ajai(s — = —2)= Aisa(| 5 | + 1) = Aisi(8;), 
the remaining 7 € S will be assigned facet coefficients based only on the partial sums that 


will never be adjusted if the procedure were allowed to continue, that is 
Ayg(z) = Ajg|_,(2) = ... = Ajai(z) = A,(z), Vz < B,. 


S/ 


OED 
Given the following corollaries, we modify Algorithm Lift to assign facet 
coefficients. We begin with a strong cover S’ that is not tight, and define the partial sum @;, 


t = 1,...,5, as the sum of the ¢ smallesta,.7 € S wheres— one 


PROCEDURE 4 (Tightening algorithm IJ): This algorithm takes the constraint coeffi- 
cients in S’ = E(S’) — S’ for the partial sums @;, ¢ = 1,...,s for a strong cover S’ and 
returns the cut coefficients w;. 


Input: Ss’ = E(S’) — S’ and the partial sums ¢,, t = 1,..., s for a strong cover S’. 
Output: w; foralli € Ce 


Begin 
Let A,(0) = 0, Ai(z) = @., z =1,..., 5, and order S’ in ascending order of a,, 
h=2 
hora ee 5 


While h < |S] +1 





i 6 — A1(s a h) 
I=b — Ai(s — (kh +1)) 
Ifa; < J, then 
Ws = h-1 
ise 
If a; < ie then 
Ws = h 
If a; < A;(s )- A;(s = h) then 
lf 2A ae) = ee 
Else Ajij(z) = min {A;(z), A:(z —h) +a;},z2=h,h+1.,...,s 
Endif 
r=7i+1 
If A,(s) =<) +1 
Terminate algorithm and assign remaining 
coefficients using Procedure 3 with current partial 
sums A;(z),2 = 0, 
Endif 
Endif 
Else 
i ial 
Endif 
Endif 
Endwhile 
Use Procedure 3 with current partial sums A;(z), z = 0,1,..., s to assign 
remaining coefficients 
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Endfor = 
Return w; for eachi € S’ 
End 


Once all w; have been assigned, the strong cover cut has been lifted to 
ys L 5+ Ys eer, = 1S |—1 
ges’ ie S! 

which is a violated facet of the knapsack polytope. 


We illustrate Procedure 4 with a simple example: 


Example 3: Given the knapsack constraint 
47, + 529 + 5273 + 6274+ 7254+ 8x46 4+ 8274+ 127g + 13279 < 16, 
anda Rone cover is S’ = {1,2,3,4}, s = 4, the corresponding strong cover cut is 
Zyttot+73+%4+ 15 +X t+2%7+F%g+T < 3, 
and the initial partial sums are 
Aree ea 9 AWS) = 14,47 (4) = 20. 


Because the smallest a; that can get a facet coefficient must be greater than b— A,(s—2) = 7, 
oa .. 
Since 
b— Ai(s — 2) < ag < b— Aj(s — 3), 
we = 2, and since 
ag < Aj(s) — Aj(s — 2) = 11, 

we must adjust the partial sums A(z): 
Oro 2. 

A(0) = Ai(0) = 0, Ao(1) = Ai(1) = 4 
ROR —=)296,.7..5, 49(2) = min A(z), Aj(z — 2) + ag} . Thus, 


Ao(2) = min{9,0+8} = 8, 


A2(3) min {14,4 + 8} = 12, 


ay 


Ao{4) = min {20,9 + 8} = 17. 


Since Ao(s) = A2(4) = 17 = 6+4+.1, we can assign the remaining coefficients using 


Procedure 3 with the partial sums Ao(z), z = 0,1,..., s. The facet is 
Zy+eo+ 43+ 24+245+276+27+ 224g + 32rq < 3. 


End Example 3 
Next, we illustrate Procedure 4 with a more complex example: 


Example 4: Given the knapsack constraint 
40x, + 41xo + 42273 + 4324+ 44¢5 + 752g + 11527 + 140rg < 170, 
the strong cover is S’ = {1, 2,3, 4,5}, and the strong cover cut is 
Yiettotrzg+erqet+r5+xrgt+77 +28 < 4, 
and the initial partial sums are 
Ai (0) = 0, Ai(1) = 40, Ai(2) = 81, Ai) = 123) Ai) = 1667 AS) =e 
The first variable we consider is xg, the variable with the smallest a; in S’. Because 
b—A;(s—2) <ag<b—Aj,(s — 3), 


On = 2 alersmee 
ag < A;(s) — Ai(s — 2) = 87, 
we must adjust the partial sums A9(z): 
Fonz <2. 
Ao(0) = Ai(0) = 0, Ao(1) = Ai(1) = 40. 
For z = 2,3,...,8, Ag(z) = min {A,(z), Aj(z — 2) + ag}. Thus, 


e 
S 
[ 


min {81,0 + 75} = 75 


ao 
bo 
on" 
co 
eae 

| 


min {123, 40 + 75} = 115 
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| 


Ao(4) min {166,81 + 75} = 156 


ADD) oem, 210; 123 + 75} = 198. 


Since Ao(s) = A2(5) = 198 > b+ 1, we cannot revert to Procedure 3. 


We consider x7. Because 
b — Ao(s — 3) < a7 < b— Ag(s — 4), 


w7 = 3. Wecan revert to Procedure 3 according to Corollary 3.7 because w7 = 3 = 3 | +1. 
Instead, we will continue the process to verify the correctness of Corollary 3.7. 
Since 

a7 < Ao(s) — Ao(s — 3) = 123, 
we adjust the partial sums again. 


Ohi. 3, 
A3(0) = Ao(0) = 0, A3(1) = Ao(1) = 40, A3(2) = A2(2) = 75. 


rons = 3, re A3(z) =i { Ao(z), Aog(z = 3) = az} : Thus, 


A3(3) = min {115,0+115} = 115 


A3(4) min {156,40 + 115} = 155 


A3(5) = min{198,75+ 115} = 190. 


Since 
A3(s) = A3(5) = 190 > 6+1 
we cannot revert to Procedure 3 (via Corollary 3.5). 


We consider zg. Because 


b — A3(s — 4) < ag < b— A3(s — 5), 


6] 


wg = 4. Note that the only partial sums we use are 
A3(s — 4) = A3(1) = Ao(1) 


and 
A3(s = 5) — A3(0) = A2(0). 
In fact, if we change the coefficient ag and let it be the smallest possible value given the 


value of a7 and the imposed ordering, ag = 115, we can see that in the worst case, 
b — A3(s — 3) < ag < b— Az(s — 4), 


and the only partial sums that would be used are A3(2) = Ao(2) and A3(1) = Ao(1). Thus, 
the last adjustment was unnecessary, and we could have assigned wg = 4 based on the 


partial sums A(z), z = 0,1. The facet is 
Yy+to+4%3+9744+ 254+ 2464+ 3274+ 4a < 4. 


End Example 4 


D. NON-MINIMAL COVER CUTS FROM THE KNAPSACK POLYTOPE 


Although a knapsack constraint may contain one or more variables with LP solution 
values x; that are fractional, there is no guarantee that an MCC exists. In the event no 
minimal cover cut exists for a candidate knapsack constraint, we develop a method that finds 
a “non-minimal cover cut” (NMCC), if such a cut exists. We distinguish between two types 
of NMCCs. A Type INMCC only requires cut coefficients of 1 for variables in the NMCC, 
and, if the NMCC is not a violated “extended minimal cover valid inequality” (TMCV), it 
is lifted by “deficit lifting” (and possibly simple lifting) to a violated TMCVI that ts, in tum, 
lifted and tightened to a knapsack facet. Type II NMCCs are valid inequalities that require 


that one or more cut coefficients be greater than 1 to obtain a violated valid inequality. 


I Non-Minimal Cover Cut-Finding Problem 
Once a candidate knapsack constraint is identified, the minimal cover cut-finding 
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algorithm is invoked. In the event that the algorithm finds no minimal cover cut, the NMCC- 
finding algorithm 1s called. We define a two-step procedure that first calculates the right- 
hand side of a “non-minimal cover valid inequality” (NMCVI), and then checks to see if the 
NMCVI1 is violated before any lifting or tightening is carried out. Given x, the right-hand 


side wo is found by solving the following IP (which uses previously defined notation): 


Formulation: 
Wo = maximize De oz 
jEN+ 
Subjectto > Gare 2b (III.15) 
jEN+ 


L 5 € ee, OG Ee N*. 


The standard dynamic programming recursion used to solve (III.15) is: 
DP Recursion 2 


Initial conditions: 
do(0) = 0, do(£) = —oo for all ¢ a 0. 


Recursion: 
ae = wiatax + dpe4(0),dp-1(¢ — a) + 1} fork =1,...,|N*| and 2 =0,..., b. 


The solution to the problem is w} = max din+\(£), and the NMCVI is 


S| 2; Sw. (III. 16) 
env 
The second step of the cut-finding process is simply to check the NMCVI for violation. The 


NMCVI (III.16) 1s a Type I NMCC if 
SF) — wp > 0. (111.17) 
jENT 


An outline of the two-step NMCC-finding procedure follows. 


PROCEDURE 5 (Non-minimal cover cut-finding algorithm): This algorithm takes 5, 
the values of 7; and a;, 7 € N*, and returns wo and the message that > 2; < woisa 


jeNt 
Type I NMCC, or returns the message that no Type I NMCC exists. 
Input: The values of z; and a;, 7 € N* and the right-hand side of the constraint b. 
Output: The message that 5° 2; < wo isa Type I NMCC and wy, or the 
Ione 
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message that no Type I NMCC exists. 


Begin 
Find wo by DP recursion 2 
If ne L, = pee 0 
jENt 
Return “NMCVI is a Type I NMCC” and wo 
ise 
Return “NMCVI is not a Type I NMCC” 
Endif 
End 


Example 2 (part a): Suppose the solution to the LP relaxation of a MIP with knapsack 
constraint 


22, +429 + 8243 + 8244+ 825 < 10 (III.18) 


Z=1, a5 — 1/4, 23 = 1/4, op = 1/4 
The knapsack constraint has four fractional variables, so it is eligible to have a cut derived 
from it. Note that any two of the coefficients a;, 7 € {2,3, 4,5} will form a minimal cover, 
so there are (5) MCVIs of two variables with the right-hand side of |S| — 1 = 1 associated 
with (III.18). But, because no sum of any two z;, 7 € {2,3,4,5} exceeds 1, no minimal 
cover cut exists. 

The first step to deriving a possible NMCC 1s to find the right hand side of the 
NMCVI by solving (IIIJ.15) with DP recursion 2. The solution is w) = 2, and the valid 
inequality is 

Lyttotaerg+xrgt+ ars < 2. (III.19) 
Checking condition (III.17) confirms that (III.19) is a Type I NMCC since 


t1+29+73+ 24+ £5 > 2. 


End of Example 2 (part a) 


Joe Deficit Lifting 


We find a facet from the Type I NMCC as we did from the MCC. If the wp + 1 


smallest a;, 7 € N* form a minimal cover, we designate the indices associated with the 
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wo +1 smallest a;,7 € N* as S and employ Procedures 1-4 as necessary to find a violated 

knapsack facet. If not, we must utilize a process called “deficit lifting” to find a TMCVI. 
Deficit lifting finds a violated valid inequality that can be lifted to a facet by exclud- 

ing variables from the Type I NMCC. To begin, we designate the variables with the wp + 1 


smallest a;, 7 € N* as members of the (possibly non-minimal) cover S°,,. 


PROCEDURE 6 (Deficit lifting algorithm): This algorithm takes S°., the vector of con- 


cur? 


straint coefficients a;, 7 € S°., the right-hand side of the constraint b, the right-hand side 


of the NMCVI wo, and returns a minimal cover S¥. and wy, the right-hand side of the 
NMCVI corresponding to S™. 


Input: S$? oe So. ., wo and b. 


Output: A minimal cover S$ for the constraint. 


Begin 
g=0 
For g9= 0, ee, lw| 
vty ~ eS, 4 
If \, ay < b 
JES2,7—{tg} 
go to TERMINATE. 
Else 
ea: oa Se. rar {ig} 
Wot1 =Wy— 1 
g= gl 
Endif 
Endfor 
emo = o2 anda), = @, 


TERMINATE: Return S$ a and wy 
End 


The resulting valid inequality 1s 


So a+ D> 24 So. (111.20) 


jes, jEeNt+—S9,, 


Of course, it would be pointless to lift a Type I NMCC with deficit lifting if the 
resulting valid inequality were not violated. Fortunately, the following result proves that a 


violated valid inequality always results from deficit lifting a Type I NMCC. 
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Lemma 3.8 4 valid inequality created from a Type I NMCC by deficit lifting will always 
be violated. 


Proof. If 
) Let ) Ly = 0, 

j€S9., JENT-SO 
then 

Ls L 5 en (ew iz 

jE So, .— Lio} jEeNt—S3Q,, 
because 
cea 


The result for S¥ follows by induction on M. QED 


13 


Note that (IJJ.20) is not necessarily a T[MCVI at this point. The actual TMCVI is 
SS Lait bs LT 5 = Wy. 
joo, jEE(SM,)-SM, 
However, since all a; > @;max, i € N* — So. wherea,_.,. = max aj, then Nt — Sous 
je 


E (Sip) — Seon 


Cur?) 


cur 


and itis a simple task to use simple lifting (Procedure 1) to lift any remaining 
variables that belong in the TMCVI. After a TMCVI is completely formed, interior lifting 
(Procedure 2) and tightening (Procedure 3 or Procedure 4) will create a facet, just as they 
did with a lifted minimal cover cut. 

We continue with example 2 to demonstrate deficit lifting: 


Example 2 (part b): We have the knapsack constraint 


20, + 429 -—- 625 orate, = Ue (1.21) 


with LP solution values 
fp = 1, to = 1/4 o3  ee e e 


and the NMCC 
Ly_t+etotrzgt+r%atrs < 2. 


Since wo = 2, we tonmlae, =e 213) 2 oince ayes min a;, the first iteration of 


cur 
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Procedure 5 finds that 


meas °. 
jES2,.—{io} 
so we form S},, = Sa, — {io} = {2,3} andw) = wo — 1 = 1. Since ag = a;, = min a, 
Dose. 
the next iteration of Procedure 5 finds that 


a4 < b, 
jES2,,—{t1} 


so S$) is a minimal cover, and 


ye Lit SS D5 < wy 


168757 jENT—Se 


is acut. The new cut is 

fot+txeg3t+a4t+ 25 < l. Cle) 
Since no lifting can be performed on (III.22) and tightening assigns cut coefficients of 1 for 
all variables not in the cover, (III.22) is a facet of the knapsack polytope associated with 
a2 1). 
End of Example 2 (part b) 


3. Type If Non-Minimal Cover Cut-Finding Problem 


Type II NMCCs are valid inequalities that require that one or more cut coefficients 
be greater than 1 to obtain a violated valid inequality. Type II NMCCs can be found by 
a three-step process. First, we solve the NMCC-finding problem. If the solution to the 
NMCC-finding problem indicates that no Type I NMCC exists, the NMCVI 1s lifted and 
tightened to a facet of the associated knapsack polytope much as we did for Type I NMCCs. 
We then examine the resulting facet-defining valid inequality. If the facet is violated, then 
we have found a Type II NMCC. If not, we must first check the strong cover S’ used to 
find the facet. If ye, a; — b = 1, then we know that we have assigned the maximum cut 
coefficient to ence in the cut, and no Type II NMCC exists. If ye a;—b > 1, there 
may exist other facets that can be found by exchanging facet apethiciente among variables 


in certain equivalence classes. The equivalence classes are defined by 
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b— Ai(s = h) <a;<b- Algy|(s = h), = Daa. sara S| —]. (III.23) 


where Alsi (s—h),h = 2,3,...,|S’| — 1 represent the last partial sums used by Procedure 4 
to find the first facet. The equivalence classes identify sets of variables that will have facet 
coefficients of either w; = h—1 orw; = h. Note that in Procedure 4, the first coefficient that 
falls in any equivalence class will have a facet coefficient of w; = h and cause partial sums 
to be adjusted. If two variables are in the same equivalence class and have different facet 
coefficients, then the facet coefficients can be exchanged so the variable with the greater 7; 
has the greater w;. 


The following procedure finds a Type II NMCC, if one exists. 


PROCEDURE 7 (Type II Non-minimal cover cut-finding algorithm): This algorithm 
takes b, the values of z; and a;, 7 € N*, and wo, and returns the facet coefficients w; for 


Li,1€ cr or returns the message that no Type II NMCC exists. 


Input: The values of 7; and a;, 7 € N*, the right-hand side of the constraint b, and the 
right-hand side of the cut wo. 


Output: The facet coefficients w, for x;,i € S’, or the message that no Type I NMCC 
exists. 
Begin 
Lift the NMCVI to a facet by using Procedures 1-6 as required. 
If ye Ti+ W;L;i — Wo > 0 
Ges: ie S! = 
Return “Facet is a Type II NMCC,” and set w; = w; fori € S’. 
Else 
If y az — | 
jes" 
Return “No Type II NMCC exists” 
Else 
For each equivalence class Q = 2,3,...,|S’| — 1 
For allz,k € Q 
Ifw; > wpand z; < Z,,71,k €E Q 
Wi) = W; and Ww, = Wk 
Else 
w, = w; lor all: € @ 
Endif 
Endfor 
Endfor 
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If >> Ti+ >> wit; — wo > 0 


jEs’ ies! a 
Return wi, for x;,7 € S’ 
Else 
Return “No Type IT NMCC exists” 
Endif 
Endif 


End 


Example 3: We have the knapsack constraint 


20, + 249 + 273 + 274+ 325 + 326 4+ 327 + 5axg < 6 (III.24) 


with positive LP solution values 
Ly — 1/4, Xo — ee £3 = 2, L4 = ie £7 — 12 


and the NMCVI 
Yyt+totr3+274t+ 277 < 3. (1.25) 
Since 
ee ee ee 3 
C1 + 29 + 23 F 24 27 = ae 
(III.25) is not a cut. If we form a TMCVI and lift and tighten it to a facet, we obtain the 


following valid inequality: 
Yet+etotxerg¢+ey4t2e5+ xr6+ 27+ 32g < 3 


but still 
Ly +79 +273+274 +225 +276 + 27+ 328 8 
because the only variables that got larger coefficients were 0 in the LP solution. We define 


the equivalence classes using (III.23): 


Equivalence Class 2<a,;<4 4<a,;< 4 
Facet coefficients w;=lor2 w;=2or3. 


Since variables x5, rg, and 2x7 are all in the same equivalence class (note the second equiv- 


alence class is empty), we find that ws; > w7 and 5 < 27, and we interchange ws and w7 
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so that w; = 1 and wt = 2. The new facet is 
uy a9 + 23 os 5 ie a oe eee 


and since 
T_+79+73+24+%5+ 6 + 227+ 328 = 3: a 

itisa Type IT NMCC. 
End of Example 3 

The procedure to form Type II NMCCs requires that we have a minimal cover from 
which we generate a facet. However, sequential lifting of facets associated with minimal 
covers does not, in general, produce all facets associated with the polytope P (Balas and 
Zemel, 1984). For facets not associated with minimal covers, a procedure similar to our 
XVMCC cut-finding procedure may be able to produce these facets. This procedure is left 


for future research. 


E. SUMMARY 


In this chapter, we developed new techniques for finding and lifting cuts from in- 
dividual knapsack constraints. We described an algorithm that finds a maximally violated 
minimal cover cut for a knapsack constraint if such a cut exists, an algorithm that lifts a 
minimal cover cut to a lifted minimal cover cut and we developed a new lifting procedure 
called “interior lifting” that lifts a lifted minimal cover cut to a strong cover cut. We adapted 
polynomial-time facet finding algorithms to tighten strong cover cuts to violated facets, and 
identified conditions and created procedures that streamline the facet-finding process. 

We identified a new type of knapsack cut, the “non-minimal cover cut,” a cut that 
cannot be found by solving the traditional minimal cover separation problem. We devel- 
oped non-minimal cover cut-finding procedures and a new lifting procedure called “deficit 
lifting” that creates a violated extended minimal cover valid inequality from a non-minimal 
cover cut, if necessary. The complete procedure of cut-finding, lifting and tightening for e1- 
ther a minimal or a non-minimal cover cut produces a violated facet in pseudo-polynomial 


time. 
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IV. KNAPSACK CUT EXTENSIONS 


This chapter develops two extensions to the results of Chapter III on knapsack cuts. 
In particular, we show how to generate cuts for “elastic knapsack constraints” (knapsack 
constraints with penalized violation allowed), and for knapsack constraints with senses of 


“ greater-than-or-equal-to” and “equality.” 


Ae CUTS FOR ELASTIC KNAPSACK CONSTRAINTS 


Our research extends the basic results on the knapsack polytope to include the gen- 


eration of cuts from elastic knapsack constraints. The elastic knapsack constraint is 


S ajajy—z <b (IV.1) 


eI! 


where the a; and b are positive integers,a; < bVj € N, x; are binary, and0 < z < Z;if 


z is not explicitly bounded above, then implicitly z =} a; — b. The variable z represents 
the additional units of resource that can be used aoe Aid beyond the basic limit of 6 if an 
appropriate (linear) penalty is paid. We develop a method to cut off fractional solutions to 
elastic knapsack constraints that parallels many of the knapsack cut procedures developed in 
Chapter ITI. Because all cuts must be valid inequalities, we first examine valid inequalities 


for the elastic knapsack constraint. 


Ihe Valid Inequalities for the Elastic Knapsack Polytope 


We again focus on minimal covers, because we can extend many of our minimal 
cover cut results for standard knapsack constraints to elastic knapsack constraints. When 
we generate “elastic minimal cover valid inequalities” (EMCVI) for (IV.1), we note that if 
z is not explicitly bounded above, the implicit upper bound of 7 = D> a; — b allows any 
integer solution to be selected for the right price. Thus, when Z is enen z must appear 


inevery EMCVI. 


7] 


The conditions for the minimal cover are altered from the standard MCVI by #4e 
addition of the variable z. S given z, denoted Ss, will be an “elastic minimal cover” for 
(IV.1) if 

Sa; > b+ [2] 


jES2 
and 


SS a; <b+|z|, Vie Sz. 
j€Sz—{i} 
Thus, an EMCVI for (IV.1) is 


za 
_— ———-. < [S| - 1. 
24% — ae 
Te j€S 
Example 1 (part a) Consider the elastic knapsack constraint 


22, + 349 + 493+ 6744+ 825 +24—,-—2< 7 (IV.2) 


where z = 3. Givenan LP solution with z = 2, anelastic minimal coveris Ss = {1, 2, 3,6}. 
The associated EMCVI is 

ey +a, +z3+26—= $3. (IV;3) 
By rearranging (IV3), it becomes clear that, when z = Z = 3, 


a“ 
Baebes» Gh Olas 


is really enforcing 
Yj t+x2o+734+ 2% < 4, 
allowing all the variables in the valid inequality to be 1. When z = 3, the rearranged elastic 
constraint (IV.2) 
22, + 379+ 473+ 6274+ 325+ 276, < 7+2 


is actually enforcing 
22, + 320 + 4734+ 6244+ 325 + rg < 10 


which does allow x; = ro = 23 = re = 1. This verifies that the EMCVI we developed is 


a “valid” inequality, as it does not disallow any valid solutions given 0 < Zz < Z. 


Ue 


End example 1 (part a) 


2: Finding a Maximally Violated Elastic Minimal Cover Cut 


We now develop a procedure to find an elastic minimal cover cut (EMCC). A “max- 
imally violated elastic minimal cover cut” (XVEMCC) for an elastic knapsack cut may be 
found by modifying the XVMCC-finding procedure found in Chapter III. Specifically, the 
objective function and constraints must be modified to account for the constraint violation 


variable z. 


a. Cut-finding problem formulation 


In order to find an XVEMCC, we must identify a knapsack constraint of the 
MIP that has at least one variable with a fractional LP solution value z;. Once a suitable 
constraint is found, we solve the cut-finding problem: 


Indices: 


j €N = {1,2,3,...,n} variable index for the knapsack constraint 
N+ ={j7€N |Z; > 0} where x is the solution of the LP relaxation of the MIP 


Given data: 


value for x; in a solution of the LP relaxation of the MIP 
value for z in a solution of the LP relaxation of the MIP 
a; knapsack constraint coefficient of 2; 

b right-hand side of the knapsack constraint 


Ny &> 


Decision variables: 


h; 1 if; is placed in the minimal cover inequality; 0 otherwise 
r isa general integer variable that is the right-hand side of the XVMCC 


Formulation: 
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— imi peas ee 
ze) = Maximize )) Zh; ~>y -r 


jENt+ 
subjectto: S> a;h; > b+ [z|/+1 

jEN+ 

D aghy < b+ [2] + emin 
jeNt 

De: a;h; —t a 0 
jeNt 

De hj; =—7- wel 
jEeN+ 
h; € {0,1} V7 ENT 
t € {b+ |z]4+1,....6+ [Z|] + ann} 


7 (GetO 1,2 ee aaa 
(IV.4) 


Wwihencia. a= =a a5. 
To ensure that all EMCCs are found, we actually solve the cut-finding problem |N*| times 
with each a; = amin, 7 € N* and requiring h; = 0 for every a; < amin. (Actually, we 
need to solve the cut-finding problem only |N*| — p times, where|V*| — p is the number 
of unique a;, 7 € N*.) 
Although the above IP is nonlinear, it can be solved fairly easily, and an 


EMCC has been found if 


— 


A * z * 
Ss Lins — Pb —r >Q, 
Jeo: 
where h*, t*, r* solve ([V4). 


b. Dynamic-programming reformulation 


We reformulate the cut-finding problem in order to solve it with dynamic 
programming as we did in Chapter III. Thus, the actual cut-finding problem we solve 1s: 
ROKK 


2,7 = lee max max », @— 1, +; 


jEN+ 
subjectto: b'< 5) a;h,; <b. 
jEeN+ 
a ee (vs) 
jEN+ 


1 


h, {0,1} Vj ENt 


t € fb',...,b"F, 
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where b’ = b+ |z| +1 and b” = b+ [Z| + amin. The problem is solved at most | +] times 


with each unique a; = amin, 7 € N~* and requiring every a; < amin, 7 € Nt to have 
hj; = 0. 


The reformulation (IV.5) can be solved via a DP recursion 
DP Recursion 3 


Initial conditions: 
do(0) = 1 
ania —cofora = 1,...,b + @nin 
d;,(a’) = —oo forall k, a’ < 0 


Recursion: 
idj.(a’) SE {d,-1(a’), dy—31{a’ — ar) a (Zi _ 1)} 


fom wl |N la = 0,~.,b +ienee. 
The solution to the problem is 


Z 





* / 
2 = 1 amax Gieela ) = 
el b! <a! <b" me A ) a’ —b 


If zz, > 0, where h”* solves (IV5), an XVEMCC has been found, and the corresponding 
elastic minimal cover Sz; = {k|hz = 1} can be recovered through auxiliary data structures 
within the dynamic programming algorithm. The XVEMCC is 


z 
ae sie 1 
eo Zee b 

. jES3 


Example 1 (part b) Suppose the solution to the LP relaxation of a MIP with knapsack 


constraint 
22, + 3270+ 473+ 674+ 345 +24—6-—2z2< 7 
1S 
~ aA A 5 aA aA A oo 
el to 1s rn were), te = |, z= 2. 


Recall the modification to the cut-finding problem changes the constraint, replacing the 


original b with b + [2] : 


27, + 379+ 473+ 624+ 325 + 26 < Y. 


ge 


The cut-finding problem looks for the most violated minimal cover cut, with 


o_o 


z 
violation = ) £5 — ————_. — |S3] - 1. 
~ Ge = (0 


JES3 7ES> 
We solve (IV5) and find the EMCC 


01+ 29 + B23 + Te — 


which is violated, since 


Violation = D8 - FT Sl -Y 
eee 7ES3 : 
Se) 
aa 
4 3 
_ tl 
wy 


End example 1 (part b) 


3. Lifting and Tightening Elastic Minimal Cover Cuts 


Simple lifting can be conducted just as with standard knapsack cuts, but interior 


lifting and tightening must be altered in order to ensure that the cuts remain violated and 


valid. 


a. Simple lifting 


Any variable with a constraint coefficient greater than or equal to the largest 
constraint coefficient of the variables in the minimal cover S can be lifted. 


Example 1 (part c) Recall the EMCC from part b: 


< 3. 


WI & 


Ej + @Qg+ 23+ LE — 
Because a4 > a3 =Max aj, the variable x, is lifted, creating the lifted EMCC 
JS 


<3: 


QO} & 


0 ea 63 a oe 
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End example 1 (part c) 


b. Interior lifting 


As with standard knapsack valid inequalities, it is theoretically possible to 
lift an EMCC to an elastic strong cover cut. However, once interior lifting is completed, the 
coefficient of the variable z in the EMCC must be recomputed using the coefficients of the 
variables in the strong cover S;. Since the cover is now strong, )) a; < >> a;, and the 

jes, 7ES3 
coefficient of z, oo is now larger. Because the z term is subtracted when calculating 
3 
j€S, 
the amount of violation, 


; oe z 
violation = ) to. = 
J 5 
) Qj = b 


JES3 jeSs 


the adjustment of the coefficient can cause the EMCC to “lose” its violation. Therefore, in 
practice, we do not use interior lifting on EMCCs that have z > 0. 


Example 2 (part a) Suppose the solution to the LP relaxation of a MIP with elastic knapsack 


constraint 
20x, + 2529 + 2523 + 4524 + 2lzr5 — z < 50 
1S 
9 sa, 8 
£4 = 9) == ie 3 =a 974 aeree =(Q),z= oa: 


The knapsack constraint contains two fractional variables. The solution to (1V5) is the 


EMCC with S$; = {1,2,3}: 


a 
ea a 


which is a cut because 


“_ 


~“_ ~_o~ ~“_ a 
Te 50 ey 
Simple lifting extends the EMCC to 
ee eee aa 
%,+279+73+ 244 1 =” 


which is still violated since 7, = 0. Next, interior lifting allows us to include the last 


1) 


variable and create an elastic strong cover valid inequality. However, we must recompute 


the coefficient of z. When we do that, the valid inequality 
z 
Dilate <b 0 tee et oe 16 ey 


is not a cut because 


“_ 


a te. Z 
Lag Elghs © agg 5) were 


End example 2 (part a) 


c. Facets of the elastic knapsack polytope 


Once we have found an EMCC, we would like to form a facet of the elas- 
tic knapsack polytope. The variable z complicates matters, as we have already experienced 
with interior lifting. Since we cannot blindly apply the results from Chapter II], we must 
carefully identify under which conditions we can create a facet of the elastic knapsack poly- 
tope. 

When the elastic minimal cover S3 is strong, and z = Dy a; — b, we can lift 
the elastic strong cover cut to a facet of the elastic knapsack sola, The conditions that 
identify if a cover Sz is strong are 

BS ay. (1V6) 
or, if there are no variables that could be lifted (with a coefficient of 1) through interior 


lifting, that is, if 


S "aj tai <b+ |Z], Vie N — E(Ss), (IV.7) 
JESz—{jmax} 
where jmax =argmax a,. If either condition (IV6) or condition (IV.7) is met, then we 
JES 
redesignate S= as the elastic strong cover Sz, and 


S 25+ oe tj — Sy SIS 
j 


ES, jEE(S4)—S! 
is a facet of the elastic knapsack polytope. 
Theorem 4.1 /f the elastic minimal cover S¢ is strong, then the elastic strong cover valid 
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inequality 


< / 
Dome, 9 —  S I -1, (IV8) 


jeS, je B(S4)-St a 
where Z =) a; — banda; < bVj EN, is a facet of the elastic knapsack polytope 
jEN 
Pe mcone J 6 (0.1.05: 5215 ans ch (IV.9) 
jEN 


Proof. The valid inequality (IV.8) is a facet of the elastic knapsack polytope if it is satisfied 
by every x € Pz, and satisfied at equality by exactly d affinely independent points x € Pr, 


where d = n + 1 is the dimension of Pr. Consider the elastic constraint 
Se QjLi — Z < b, (IV.10) 
jEN 

where a; < bV7 € N, a, +a2 >6+2,n =|N| and z is not explicitly bounded. 


Since S is strong, a strong elastic minimal cover valid inequality for (IV.10) 


é / 
Let Dd) ys SISH- 1 (V1) 


jeS, 


jeSt j€E(S4)-Sb 


where z = i” Gee 
jEN 





Table 1. This table contains the n linearly independent points that demonstrate the elastic strong cover valid inequality 
(where |S;| = 2) is a facet of the elastic knapsack polytope for the strong cover Ss when E(S3) = N. No = a1 +a2—b 
and 5. = a1 +a2+a, —b,k =3,4.,..., 7. 


In Table 1 there are n linearly independent points that satisfy (1V.11) at equal- 
ity, and since linear independence implies affine independence, the dimension of (IV.11) is 


at least n. Since the dimension of the elastic polytope Pg is n + 1, (IV11) is a facet of Pe. 


no 


The result for |S] = k, k > 2 follows by induction on k. 
Note: We can easily form |N — E(S3)| other linearly independent points for 
the case E(.S3) < N to verify that the facet has appropriate dimension when variables are 


implicitly assigned a facet coefficient of 0 by their exclusion from the inequality. OED 


When we have an EMCC and z > 0, we must forego interior lifting. Thus, 
if Ss is not strong, we will not create a strong cover from the elastic minimal cover, and the 
(possibly lifted) EMCC may not be a facet. This next example shows why this is true. 
Example 3 Suppose the solution to the LP relaxation of a MIP with elastic knapsack con- 


straint (with z not explicitly bounded) 


2021 + 2029 a Zee arr ae = 40 


1 ia 
L1 = ee = 95°73 = Uz =a 
The knapsack constraint contains one fractional variable. The solution to (IV.5) 1s the EMCC 


with .Ss — "4 eae 


a ee (1V.12) 


crt & 


which is a cut because 


ox ow a 
Dee 


When we include x3 by interior lifting, 
a 
Dr ae <1 


is not a cut because ” 

#1 + 22+ 33-2 <1. 
So, we must use (IV.12) as a cut. But, is it a facet of the elastic polytope? Recall that a 
facet of the integer polytope Pr (IV.9) is an inequality that is satisfied by every x € Pz, 


and satisfied at equality by exactly d affinely independent points x € Pg, where d is the 
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dimension of Pg. We examine the points that satisfy (IV.12) at equality in this table: 





Note the points that satisfy (IV.12) at equality, but are not in the polytope Pr. Since we 
only have 3 points x € Pg that satisfy (IV.12) at equality, and the dimension of Pr is 4, we 
cannot possibly have four affinely independent points that satisfy (IV.12), so (IV.12) cannot 
be a facet. 


End example 3 


d. Tightening 


In the previous section, we developed a procedure to generate strong cuts 
and facets for elastic knapsack constraints with an implicit upper bound z = )> a; — bon 
the constraint violation variable z. When z < > a; — b, the elastic knapsack Leis will 
not allow all variables to be set to 1 at the Scnaee and some of the variables lifted into 
the EMCC may require coefficients greater than one. We can use the tightening Procedures 
3 or 4 from Chapter III by deriving the appropriate coefficients w; for variables x, as if they 
belonged to the knapsack constraint 

2 Gye 0 a 2: 
jEN 
To use Procedure 3, the elastic cover must be tight, that is 
Ss” Ge Ui tl. 
jES3 
If the elastic cover is not tight, Procedure 4 must be used. To use either procedure, substitute 


b+ 2 for b. The EMCC is then tightened to 


zs 
S" i Ss W st 5 a pois < | S| — il, 


JES, j€E(S4)~St pee! 
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which is a strong cut (perhaps a facet) for the elastic knapsack polytope. 

We can also use these tightening procedures when S3 is not strong by ignor- 
ing any variables z;,7 € N — E(S>) that do not meet condition (IV.7). But, in this case, we 
know that we will not form a facet. 


Example 2 (part b) Given the knapsack constraint 
202; + 2529 + 2523 + 4524 + 21lz5 — z < 50, 
and z = 10, we tighten the cut formed in Example 2, part a, 


Vb 
SA a ee 


by rewriting the constraint with the substitution 6 + Z for 6b: 
202; + 2529 + 2523 + 45274 + 2lzs5 < 504+ 2 = 60. 


Since 5° a; > b+2+1, we use the Procedure 4 lifting process in Chapter III. Thus, we 
jeSs 
assign w4 = 2, and the new valid inequality is 


eZ 
i 2 aaa 


End example 2 (part b) 
Note that we ignored the variable x5, the variable that, through interior lift- 
ing, removed the violation. Our lifting process is still valid, but we forego the possibility 


of finding a facet of the elastic knapsack polytope. 


4. Non-Standard Elastic Knapsack Constraints 


We consider a variant of (IV.1) where one or more a; > 6, 7 € N. When an elastic 
minimal cover is found with one of the variables having such a constraint coefficient, the 


valid inequality (and cut) derived is altered. Define 


< = {jla; > b,j € So}, 
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and leta? =e a;. For any elastic minimal cover containing such a variable, the valid 
je 


inequality is 


yA 
ys Lir Ms i, Se 
jest JeE(S,)—St Jmin 
where the coefficient of z has changed from —= ——y to +. The cut-finding problem 
: a 
JESS 
must be amended to reflect this coefficient change as well. 





Jmin 


We also can derive cuts for another elastic constraint, 
) Ger ate: 
jeJ 
After a simple conversion, discussed in the next section, the constraint becomes of form 


(JV.1), and all procedures in this section can be applied. 


B. KNAPSACK CONSTRAINTS WITH NON-STANDARD SENSES 


All our results thus far have been for the knapsack polytope associated with the 


“standard” form 


Saja; <b. (IV.13) 
jEN 
Our results are easily adapted for knapsack constraints 


S| aja; > b (IV.14) 
jEN 


and 


> ajlj = b 
jEN 
where a, and b are positive integers, x; are binary variables, and N = {1,...,n}. 


1. Greater-Than-Or-Equal-To Knapsack Constraints 


We use our existing algorithms by simply converting (IV.14) to the form of (IV.13). 
This is accomplished by replacing the variable z; with its complement (1 — y;). (Crowder, 


et al. (1983) substitute complementing variables to convert less-than-or-equal-to knapsack 
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constraints with one or more negative coefficients a; to (IV.13).) Thus, by the substitution 


in (1V.14), we have 
> 2i(1 — ys) 2 8, 
JEN 

the new standard knapsack constraint 1s 


>. 9395 S$ Shay (IV.15) 
jEN jEN 
where a; and )> a; —b are positive integers,the y, are binary variables, and N = {1,...,n}. 


jEN 
Once (IV.15) is formed, we find the complementary LP solution values y; = 1— 2). 


We then apply one of the cut-finding problems and, if an XVMCC or an NMCC exists, all 


lifting and tightening procedures are applied and we find a facet 
Sat > w5y5 < (S'|-1. 
jes! jes! 
We now transform the facet back into the original variable space before appending it to the 


MIP. The facet added to the MIP is 


sy Cai > oa, = ee 


jest jes’ jes’ 


Example 4 Suppose the solution to the LP relaxation of a MIP with knapsack constraint 


47, + 4294+ 22734 224 + 5x5 + 326 + 9x7 + 32g + 82g > 30 


Lt) = Fg OS ae ea a. l,z7= 1,zg= 1,%g = L 


The knapsack constraint has two fractional variables. The transformed knapsack constraint 
Ay, + 4yq + 2y3 + 2y4 + Sys + 3yg + 9y7 + 3yg + 8y9 < 10 


has a transformed LP solution of 


“-o~ 


Ue 


=) 
| 
i 
<7 
| 
‘on 
=) 
| 
u 
7 
| 
> 
f 
Sno, 
V 
or 


> — Oe 


| — 


The solution to the XVMCC-finding problem is an XVMCC with minimal cover S$ = 
le, 3, 4} 

Vier ¥2 1 Yar Ya = 9. 
Applying Procedures 1, 2 and 3 yield the facet 


Yi Yo Ys 4 U4 + U5 + Yo + Sy7 + 2yq < 3. 
Transforming back to the orginal variable space yields the facet 
2y_+294+9734+2%4+275+276¢+ 327+ 229 > 8 


which is now appended to the MIP to cut off x. 


End example 4 


Z Equality Knapsack Constraints 


We can use our existing algorithms for knapsack constraints with equality senses, 


S > ajz; =a) 


also. First, we convert 


JEN 

to 
D052; <b (IV.16) 
jEN 

and 
S| ajx; > b. (IV.17) 
JEN 


Then we convert (IV.17) by complementing, and apply all applicable procedures from Chap- 
ter III to both constraints that are now of the form (IV.16). 
Example 5 Suppose the solution to the LP relaxation of a MIP with knapsack constraint 


221 + 209 + 3273+ 424 =) 


is 


8) 
| 
i 
8) 

bo 
I 
ies 
8) 
w 
I 
CO [ 
&) 
bo 
| 
© 
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We can represent the constraint by 


and 
224 == 229 + O03 Ss 4x4 = Oe (IV.19) 
The lifted and tightened minimal cover cut for (IV.18) is 


Xj, +eo+4%3 + 224 < 2. 


We transform (IV.19) by complementing, which yields 


2y1 + 2yo + 3y3 + dy4 < 6, (1V.20) 
with a transformed LP solution of 


Pa a eos 
y, = 0, ae 3 3? ise 


A minimal cover cut for (IV.20) is 
y3t+ya Sl. 


Transforming back to the original variable space yields the cut 
Das aA = i 


Both cuts are now appended to the MIP to cut off x. 


End example 5 
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Vv. EXPLICIT-CONSTRAINT BRANCHING 


In this chapter we develop the new technique of “explicit-constraint branching” 
(ECB) to improve the branch-and-bound portion of composite enumeration. Special Or- 
dered Sets and Foster and Ryan’s branching technique for overlapping set-partitioning con- 
straints (Foster and Ryan, 1981) demonstrate how constraint branching can improve the so- 
lution process for MIPs, but these implicit-constraint-branching techniques require a special 
problem structure. ECB adds structure to a MIP by adding new constraints and new inte- 
ger variables and does not require any special relationships within the problem structure. 
Like implicit-constraint branching, the goal of ECB is to moderate the branching process 
by more “evenly” partitioning the feasible region of the LP relaxation of the MIP The value 


of this simple technique is demonstrated by empirical evidence presented in Chapter VI. 


A. INTRODUCTION 


ECB adds one or more constraints of the form 


ye a;z;—y; = 0 (V.1) 


J€ Ji 
to a MIP where J is the set of indices of integer variables of the MIP a, are integer constants, 
J; © J, and the y; are general integer “branching” variables. For reasons discussed later, 
we assume a; = 1 forall 7 € J; in the following discussion. 

Each ECB constraint is created (with a; = 1V 7 € J;) to allow the branch-and- 
bound process to branch on a sum of integer variables before branching on any individual 
integer variable in the sum; intuitively the sum should be integer before all of the individual 
variables in the sum need be integer. We implement this by setting the “branching priority” 
higher for the branching variable y; than the z; in the branch-and-bound algorithm. (Modern 
integer-programming solvers usually allow this branch-and-bound option.) Then, whenever 


branch and bound sees an intermediate solution with some non-integer y;, branching derives 
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the two restrictions for the MIP at the current node 
yi = |y| or y; > [y;| +1. 


Branch and bound will only derive restrictions from a fractional z; when all y; are integer, 
continuing to do so unless some y; becomes non-integer again. 

The following series of examples demonstrate how ECB might be applied. First, 
we repeat the example of Chapter I to illustrate ECB where only a single ECB constraint is 
added, and to illustrate the potential effectiveness of the technique. 


Example 1. Recall the binary IP of Example 2, Section [.3: 


maximize )  g; 
jeJ 
subject to: ys opens D || “|e os 
jeJ 
pe (On avemomes 
Variable-based branch and bound forms a partition based on the one fractional variable, 


which we designate as z;,, and derives the restrictions 


UO eae 


The process of fixing variables and fathoming nodes continues until all (\13 ) alternate 
2 


optimal solutions are found and the first is declared optimal. 
We reduce the amount of nodes branch and bound must enumerate by adding an 


ECB constraint and creating the problem 


maximize ). a; 
jeJ 


4 
subject to: }> 22, ao a +] 
jeJ 
2,2; —-y = 0 
jeJ 
cg Ee {0,1} VieT 
jen eee oye 


The variable-based branch-and-bound partition based on y derives the restrictions 


eM ory > [UI 
is 5 ory = 5 +1, 
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and branch and bound evaluates only three LPs before the problem is solved. Thus, by 
branching on the sum of integer variables, we solved the IP without fixing any binary vari- 
ables. 
End Example 1 

Another example demonstrates how a single ECB constraint might be used with set- 
packing, set-covering, and set-partitioning problems, and hybrid versions of these problems. 
Example 2. 
part (a). Consider an IP, 


minimize ) > c;2x; 


jeJ 

subject to: >  a,;2; = Va em 
jeJ 

tee 40:1} owe J, 


where the a;; € {0,1}, constraints with a sense of < are set-packing constraints, constraints 
with a sense of > are set-covering constraints, and constraints with a sense of = are set- 
partitioning constraints. An obvious requirement for any solution of this class of problems 
is that the sum of all binary variables be integer. This requirement can be satisfied in a 
branch-and-bound algorithm (before requiring all binary variables to be integer) by adding 
the construct 

we t;—-y=0, 

7€J 
where y > 0, and integer. Again, the branching priority is set higher for y than for the z;. 
part (b). 


A specific example demonstrates how one ECB constraint can reduce the work of 
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the branch-and-bound algorithm in a set-packing IP Consider the set-packing IP: 


K 


maximize )> (rp, +2k +k) 
k= 
e K 
subject to: )> (zz, +2n,) < 1 
ico 
a1 
dy (Lig +L kg ae 
k=] 
K 
al Lk +Zk3) <r 


= 
ll 
ph 


Dike ees Dien tele = | fae 


This problem consists of aset of K “odd cycles” of length three (e.g., Hoffman and Padberg, 
1993). Without loss of generality, we may assume that an optimal LP extreme point solution 
will be of the form 

1 


Ly sl ae ae Cy, =, = w= OV A> 1. 


1 


It is relatively straightforward to see that the best-case branch-and-bound scenario must 
solve approximately K LPs, and the worst-case scenario must solve approximately 3K 
LPs before a declared optimal solution is found. 

By adding an ECB constraint 


i 


S| (2k, + Bey + Tks) — y = 0 
kc! 


and branching on y first, our initial separation will be 


K K 
Ge ap 6G fon. te Tm < lor ST fae 2 ke ae ae) Bes, 
i k=] 


The LP resulting from the second constraint is infeasible, and the LP resulting from the first 
constraint finds a declared optimal solution to the problem, since all feasible LP extreme 
points have some zz, = 1, and all the other variables 0. 

Larger problems with sets of these constraints embedded in the constraint set can be 


handled with cuts of the form 
De + ois oe 1 ee 
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but this entails first searching for and finding all sets of odd cycles. ECB deals with this 
issue without such overhead. 

End Example 2 

Example 3 Consider an IP for a capacitated plant location problem: 


nm mM 


minimize Ss CijXig + yy Tie: 
t— lg 1=] 
subject to: oe = | Vj 
ae 
bi D523; = Kiz; < 0 Vi 
j=l 
i al ke 
1=] 
cs a= U Note 
Lig e {0, \} V1,Vj 
2, (Et O,1) va 


where D; is the demand associated with customer 7 and K; 1s the capacity of the plant 
located at 2. If z; = 1, then a plant is located at z, and if z;; = 1, then customer j’s demand 
is Satisfied by the plant located at z. 

Before we form any ECB constraints, we set the branching priority higher for the 
plant location variables z; than the branching priority for the customer variables x;;. This 
ensures that branch and bound decides which plants are opened before deciding which indi- 
vidual customers will be served by a plant. (This 1s equivalent to the “propagation branch- 


ing” described by Guignard and Spielberg (1977).) We also add the ECB constraints 


m 
S| ty — yi = OVE. 
j=1 


to ensure that the sum of the customers for each opened plant is integer before branching 
on any individual customer. Branching priorities p,, for variable w are set as follows: p,, > 
Py; > Pz,;, where the largest priority is branched on first. 
End Example 4 

In similar problems where the number of facilities, such as plants, warehouses, or 
distribution centers is not fixed but is perhaps bounded (Geoffrion and Graves, 1974), it 


makes sense to add an ECB constraint to ensure that the number of facilities opened 1s in- 
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teger before branching on sums of customers. In our plant location example, if we replaced 
the requirement to open k plants with an upper bound of k instead, we could add the ECB 


constraint 


Tt 


where y € {0,1,2,...,k}, and assign branching priorities py > pz, > py, > Dz;;- 


B. GENERAL EXPLICIT-CONSTRAINT BRANCHING 


We define two different variants of ECB. “Basic ECB” allows a variable to appear 


at most once 1n an ECB constraint. The added constraints are 


> 25 - y= 0, (V.2) 


jEed; 
where the J; are all disjoint subsets of J; the y; are assigned higher branching priorities than 
ewe 
“Nested ECB” uses the subsets of the variables from basic ECB constraints to add 


constraints of the form 


Ss” t;—%y, — Uk = |Z... 

Jeon 
where J;, C J;, and all J;, are disjoint. In this case, the y; are assigned higher branch- 
ing priorities than the y;,, which in turn are assigned higher priorities than the z;. We can 
recursively form more nested constraints from each previously formed nested constraint 


(Ji, C Ji,,q =1,2,...,Q), so that we have multiple “levels” of nesting, and thus multiple 


Kq 
levels of branching variables where the priorities are commensurately assigned. 

Nested constraint branching could also be implemented using a “bottom up” ap- 
proach. Let J; U JgU... UU Jm = J define a partition of J, and create the bottom level of 


ECB constraints 
SS LS yy =r ae 


JE Sk 


oe 


Then, form the next two levels 


Sue — 9p =0, 


ke Ke 

/ i} 
; ) Ta Up = 0, 
EL» 


and so on. Branching priorities would be determined so that p,, < py, < Py, < Pyy, ete. 


This bottom-up approach to nested ECB is not implemented in this dissertation. 


C. CONSTRAINT-BRANCHING PROCEDURES 


We distinguish between different applications of branching techniques. A static pro- 
cedure adds branching constraints before the MIP solution procedure has begun. In practice, 
we decide the number and composition of ECB constraints to add for a static procedure by 
examining of the constraint set of the MIP A dynamic procedure adds branching constraints 
during the branch-and-bound process, using information gleaned from solutions of LP re- 
laxations at nodes of the enumeration tree. This procedure is similar to the cutting-plane 
procedure called “branch and cut.” One such dynamic procedure has been used by J6m- 
sten and Varbrand (1991) to solve generalized assignment problems. These authors refer to 
the technique as “generalized branching” and credit J6rmmsten and Larsson (1988). Implicit- 
constraint branching is another dynamic procedure that uses solution information from the 
LP relaxations in the branch and bound to partition the set of variables. We have developed 
“semi-dynamic ECB” that uses LP solution information to determine the composition of 
the added ECB constraints. We explain semi-dynamic ECB in the context of nested ECB 


in Section D. We consider only static and semi-dynamic procedures in this dissertation. 


D. APPLICATIONS 


1. Basic ECB 


Problem structure will often dictate how basic static ECB constraints should be 


added. For instance, in the generalized assignment problem (GAP), defined in Chapter 
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II, there are knapsack constraints 


Sy hotZot = elise 


o€Ot 


Lot € {0,1}, for each truck ¢. It is intuitively appealing to enforce the requirement that 
“the sum of order variables on a truck must be a general integer” before enforcing the 
requirement that “each order variable on a truck must be binary.” Furthermore, there are 
many fewer of the former requirements to satisfy (typically, |T] <<}~ |O,|), and satisfying 
them first may achieve satisfaction of the latter requirements with little or no additional 
work. This enables us to solve, or nearly solve, the GAP by branching a modest number of 
times on a small number of general integer variables rather than branching many times on 
a large number of binary variables. 
We implement basic ECB by adding the following constraints to the GAP: 

Si ta ere 

o€Or 
where the y; are general integer variables. This modified GAP has |T| new constraints that 
must be satisfied and |7| new integer variables that must be solved for. We hope that the 
additional burden placed on the LP solver embedded in the branch-and-bound algorithm, 
(LP solvers operate, on average, in polynomial time), 1s outweighed by the potentially ex- 
ponential reduction in the number of LPs that must be solved. 


We could form the ECB constraints 


SS hole: — Ue tee © 1, (V3) 
o€Ot 


which correspond to our original definition (V.1), and treat y,; as a general integer branching 


variable, but at any node, the two restrictions 


ye < ly: ory: > lye] +1 


may be imprecise, that is there may not exist any set O} C O; such that 5) ho: = |y:| or 


o€O} 
ee ee ra l yz a i 


o€O; 
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To efficiently branch with an ECB constraint of the form (V3) entails finding the 
feasible values of yt : Y1,; Yto> Yig> «+» Yt,» Perhaps by dynamic programming, and enforce 
branchings so that if 

Ye, = yt < Vinay 


then the branching rule will be 
a Vey Or yt 2 Thre 


where possibly ee —y;, 4 1. Itis possible to branch on y; where the values y/ eye. 
are specified by a sequence with some solvers (e.g., the XA Solver, (GAMS-The Solver Man- 
ual, 1993)), but we are not guaranteed that the feasible values of y, will correspond to any 


given sequence. We will not pursue this constraint branching technique in this dissertation. 


Z Nested ECB 


When using nested ECB, it is important to remember that our goal is to reduce the 
amount of work the variable branch-and-bound process must do. If we add too many ECB 
constraints, we can easily defeat this purpose. For example, we could add an ECB constraint 
(V.2) and then split J; into two disjoint subsets J;_, and J;,, and add constraints for them. If 
we recursively continue this process until we eventually form ECB constraints containing 
a single binary variable, then we have added many more general integer variables than the 
number of binary variables that we began with, which will likely be counterproductive. In 
practice, we have discovered that adding only a few nested ECB constraints for each basic 
constraint works well. The decision of the number of ECB constraints to add and their 


composition depends on the procedure that is used. 


ae Static ECB 


For static nested ECB, we use the number of variables z; in the basic ECB 
constraint to determine the number of nested constraints to add to a problem. In general, for 


each set of variables J; C J, (where J is the set of variables in the problem), the technique 


7 


adds an ECB constraint 


> 5 — Hs = 0, (V4) 


Jed, 


where y; is a general integer variable, and then adds constraints 


S23 -y, =0, KEK, 
j€Ji, 
where — 4)... ane. =U J;, and J;,, 1 J;, = @Vm,p € K. When adding these 
constraints to a MIP we set branching priorities such that y,; has the highest priority, the y;, , 
k € K, have the next highest priority, and the z; have the lowest priority. 
We apply nested ECB to the GAP by adding the basic ECB constraints 


te 0 veces (V5) 


o€O;: 


and then adding only one level of nested constraints 


NS” to — yy, =OVEET, VEE Ky, 
o€Ot, 


where the O,, are disjoint sets of variables in the nested ECB constraints, O;, C O; V 
k, K, 1s the set of indices of the nested ECB constraints, and U O,, = O,. Forins 
application, |K,| depends on |O;|. For our test problems, we have found that if |O,| is 
small, say |O,| < 8, it makes little sense to form any nested constraints, and the basic ECB 
constraint will suffice for that particular knapsack constraint. If 8 < |O,| < 16, we add 
|| = ||O,| /2] = 2 nested ECB constraints, each of which will also have at least four x, 
variables. If |O,| > 16, we create |K,| = ||O,| /2| = 4 nested ECB constraints, each of 
which will have at least four x,, variables. 

When using the technique of nested ECB as described above, there is always 
a redundant ECB constraint formed. Thus, we omit one of the nested ECB constraints when 


using this technique. 


Lemma 5.1 When partitioning the variables in a basic ECB constraint into |K | disjoint 
Subsets Such ial 1 = lao el =U J;,, and J;,, 0 J;, =WV m,p € K, only 
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nested ECB constraints need to be added to achieve the branching effect of n nested ECB 
constraints. 


Proof. Consider the basic ECB constraint 
S 2;-yi =0. (V6) 
jEd; 

In order to add the n nested constraints, we partition the variables 7 € J; into n disjoint 


subsets such that K = {1,...,n}, J; =U J;,, and J;,, 1 Ji, =0Vm,p € K. Now, we form 


DL ti = Mie: 
jJEJi,. 
If we add the first n — 1 nested constraints, when y; and y;, are integer fork = 1, 2,....n—1, 


the n constraints of the form 


the higher branching priority of y; ensures that 


ye Lie ee yiznjee QED 


jd. 


We have discussed one example of adding nested constraints in the context 
of static ECB. Next, we discuss how we use a semi-dynamic procedure to form nested ECB 


constraints. 


b. Semi-dynamic ECB 


Semi-dynamic ECB uses information from one or more LP solutions to de- 
termine the composition of the nested ECB constraints. We can implement this technique 
by simply solving the LP relaxation of the IP order the fractional variables in some mean- 
ingful way (perhaps focusing on those variables with z; ~ .5; i.e., “furthest” from being 
integer), and apportion the most important fractional variables as evenly as possible among 
the nested ECB constraints. 

When we combine ECB and knapsack constraint generation in composite 
enumeration, we have information from the LP solutions in the constraint generation phase 
that we can heuristically use to decide how to implement ECB. In the constraint generation 


phase, we typically solve an LP generate knapsack cuts (if they exist) for each knapsack 


oY 


constraint, solve the modified LP and recursively generate cuts and solve LPs until no more 
knapsack cuts can be found. 

To implement semi-dynamic ECB, we form a vector f, and use it to record the 
number of LP solutions f; in which the variable z; is fractional in the constraint generation 
phase. We use this information to decide the composition of the subsets of variables for 
each nested ECB constraint and also use the information to decide how many nested ECB 
constraints will be added for a particular basic ECB constraint. Intuitively, we hope that 
variables that are nearly always integer (f; small) in the constraint generation phase will 
stay integer in the LP solutions during the branch and bound. This should allow our nested 
ECB constraints to focus on the variables that are more likely to be fractional in the branch 
and bound (f; large). 

Just as with the description of SOS Type 1 in Chapter I, we would like to 
choose subsets of variables so that those with fractional 7; are evenly apportioned among 
all subsets. If there are |K,| nested ECB constraints to be added, then the variable that 
has been fractionated the most is placed in subset J;,, the next most fractionated variable 
is placed in J;,, and so on until the first |A,| variables are each placed in separate ECB 
constraints. The (|;| + 1)st variable is then placed in subset J;,, the (|K,| + 2)nd in J;,, 
and so on until all variables are placed in a subset, effectively distributing the most-often 


fractionated variables fairly evenly among the |K;| nested constraints. 


3. Comparison of Dynamic and Static Techniques 


After developing the technique of ECB, we discovered a reference in JOrmmsten and 
Varbrand (1991) to a technique called “generalized branching” developed by Joérnsten and 
Larsson (1988). (The original research report is unavailable at this time.) They describe 
two different branching techniques for the generalized assignment problem, but the one 
that resembles ECB is of interest here. Their dynamic technique at a node v; examines the 


knapsack constraints 


Ss Wert lols 


o€O: 
and checks to see if S~ 2, is fractional in the solution to LP (7). If so, the restrictions 
o€O: 
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derived at v; are 


Os b 2 or So te > > a +1. 


o€O;: o€Or o€Or o€O; 


Thus, LP (j;) at v;, is LP (7) with the first restriction added, and LP (j2) at v;, is LP (j) 
with the second restriction added. This means that for each truck t, there is a constraint 
added eachtime 5 > z,; is fractional and chosen to derive restrictions at a particular node. 
Static basic ECB in our GAP application described in Section V2 will branch in exactly 
the same way, except we have no need to modify the standard variable-based branch and 
bound. Because we have added a basic ECB constraint for each knapsack constraint in the 
GAP 


SO te ye SH OVEET, 


o€O:r 
and set the branching priority higher on the y; than for the x,;, branch and bound will enforce 


the same constraints explicitly added by generalized branching by simply enforcing the 


branching priorities specified by the ECB technique. 


oo 
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VI. COMPUTATIONAL RESULTS 


Knapsack cuts and explicit-constraint branching have been implemented and tested 
on sets of generalized assignment problems (GAPs). Explicit-constraint branching has also 
been tested on set-partitioning and other problems. We begin by giving an overview of 
the implementation. Then, we summarize computational results from a set of 84 randomly 
generated GAPs. (Detailed results of these problems are presented in the Appendix.). We 
present detailed results of eight real-world GAPs (standard and elastic) from the petroleum 
industry and several binary integer problems, including some set-partitioning problems. 

The composite solution algorithm is coded in C and uses CPLEX 3.0’s callable li- 
brary (CPLEX, 1993) to solve linear programming relaxations and to perform branch and 
bound on the integer program as modified by our techniques. If knapsack cuts are to be 
added to an IP an LP is solved, and a knapsack cut is added for each eligible knapsack 
constraint if such a cut exists. This procedure is iterative, so if any cut is added in the 
first iteration, a new LP is solved in a second iteration, cuts are again derived from eligi- 
ble constraints, if possible, and so on. Cuts added in previous iterations are candidates for 
cut generation as well since they are also knapsack constraints. This iterative process ter- 
minates when no more cuts can be found, or after 20 iterations of adding knapsack cuts, 
whichever occurs first. Then, if ECB will be used, ECB constraints and variables are added 
and branching priorities are specified for the general integer branching variables. After 
all knapsack and ECB constraints are added, the modified IP is then solved by CPLEX’s 
branch-and-bound solver. All CPU times reported here are from an IBM RS-6000 Model 
590 with 512 megabytes of random access memory. We allow a maximum of 1000 CPU 
seconds with a relative optimality criterion of 0.5% for all GAPs. Optimality criteria for 


other problems are specified elsewhere. 


A. GENERALIZED ASSIGNMENT PROBLEM 


The GAP is difficult; real-world problems with as few as 200 variables cannot be 


solved with standard branch and bound. We use two sets of GAPs to test knapsack cuts and 
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basic ECB. The first set consists of 84 randomly generated problems taken from the liter- 
ature (Osman, 1994, Beasley and Chu, 1995, Cattrysse et al., 1994, Beasley, 1997). These 
problems allow each order to be delivered by each truck. The second set of eight real-world 
problems (Brown, 1995) has many orders that can only be delivered by specific trucks; this 
apparently makes these problems more difficult to solve than randomly generated GAPs of 
comparable size. 


The basic formulation of the GAP (in terms of delivering orders on trucks) is 


minimize — 9) peso, 


o€OtEeT 
subject to: eae ones Ebnai 
teT> 
X hotoe < Hz Vt (TRUCKHOURS) 
o€Or 


Mm 


{0, ie Vo € Oe te Le 


Lot 


(A complete description of the GAP with all data, indices, and variables defined appears in 


Chapter II.) To implement explicit-constraint branching, the GAP is modified to 


minimize >) >> Co:Zor 


subject to: Seca = Ivo (ORDERS) 
tETo 
o€O:r 
OL a 0 0 Vt 
o€O:r 
te € {0,1} VoEe Ot ET, 
ae = Ore On Vt. 


B. RESULTS FOR RANDOMLY GENERATED GAPS 


We summarize the problem size and results for the 84 randomly generated GAPs in 
Tables 2, 3 and 4; detailed results appear in the Appendix. These problems are solved with 


a maximizing objective function. The notation used in the tables of results 1s: 
BandB. Branch-and-bound solver only. We attempt to solve these problems using only the 


CPLEX branch-and-bound solver, branching on the variable with maximum infeasibility. 


(This branching option was used throughout all computational tests.) 


hoe 


[# Variables | Trucks | Orders | Constraints | Variables 


Table 2. Average problem size for randomly generated GAPs. There are 64 problems with under 1000 variables, and 20 
that have at least 1000 variables. 


KS. Knapsack cuts are added before applying the CPLEX branch and bound solver to the 
modified IP 

ECB. ECB constraints and variables are added and branching priorities specified before 
applying the CPLEX branch and bound solver to the modified IP 

KS/ECB. Knapsack cuts and ECB constraints and variables are added and branching pri- 
orities specified before applying the CPLEX branch and bound solver to the modified IP 
Solved. Percentage of the problems that were successfully solved in under 1000 CPU sec- 
onds. 

CPU secs. The average time in seconds required to solve each problem that could be solved 
in under 1000 CPU seconds. 

Nodes. The average number of nodes in the branch-and-bound tree required by each prob- 
lem that was solved in under 1000 CPU seconds. The letter “K” indicates thousands of 


nodes. 


-___| BandB]_KS_| ECB | KSECB | 
CPU sees| 882] 43, 69] 29, 
Table 3. Summary of computational results for random GAPs with fewer than 1000 variables. An average of 22 knapsack 


cuts are added per problem for each solution procedure using knapsack cuts (KS and KS/ECB). The average time and 
nodes for branch and bound reflects only those problems that were solved in under 1000 CPU seconds. 






As seen in Table 3, over half of the smaller GAPs cannot be solved by standard 
branch and bound alone, but any of the techniques developed in this dissertation will solve 
all 64 of these problems. Table 4, which covers the large problems, also demonstrates the 
inability of standard branch and bound to solve GAPs. More importantly, 1t demonstrates 
that some of the larger GAPs cannot be solved when knapsack cuts or ECB are applied 


individually, but used together, these techniques solve all of the randomly generated GAPs. 
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/____ | BandB |_KS_[ ECB] KSIECB_ 


Table 4. Averaged results for random GAPs with 1000 variables or more. An average of 42 knapsack cuts were added 









for each problem successfully solved with knapsack cuts and branch and bound, and an average of 48 knapsack cuts were 
added for each problem solved with knapsack cuts, ECB and branch and bound. “CPU secs” and “Nodes” reflect average 
data for those problems solved in under 1000 CPU seconds. 


C. RESULTS FOR REAL-WORLD GAPS 


Here we test ECB and knapsack cuts on a set of eight real-world GAPS from the 


petroleum industry. Table 5 lists the basic statistics for these problems. 


rLONGD.| 8] 2, SS] 
PLONGN | 6, aif iT 
DLWRD | _19[ 70, —SC=«S TCD 


Table 5. Problem statistics for real-world GAPs. 









Table 6 lists solution times and the number of branch-and-bound nodes for all solu- 
tion techniques applied to these GAPS. However, four of the problems are infeasible (de- 
noted “INF” in the “Time” column) because not all orders can be delivered in the time 
allotted to the trucks. These problems must be “elasticized” in order to obtain feasibility. 
We address solving the elastic version of these GAPs later in this chapter. 

Ignoring the infeasible problems, Table 6 shows that knapsack cuts solve only one 
real-world problem when used alone. This stands in sharp contrast with the randomly gener- 
ated GAPs. ECB solves all problems with the exception of DLWRD. As with the randomly 
generated GAPs, all (feasible) problems are solved when ECB and knapsack cuts are com- 


bined. 
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Model 
Name 
PLONGD | _INF[ NA] INF[ NA| NIA| INF[ NA] INF[ N/A 
LONGN | INE[ wa [INE Wa WA [INE | NA INF | WA. 
PBEWRN | Clo00) [14@R) | 58211080 a Tee BE SE TO 
OSD [—INF[ NIA INF] NIA NA INF NA INF [NT 
PLOSAN | INF[ NA] INF] _N/A| NIA] _INF[ NAT _INF[ N/A 


Table 6. GAP solution results. Time is in CPU seconds. Problems with CPU time “(1000)” could not be solved in 1000 
CPU seconds. Nodes are the number of nodes in the branch and bound enumeration tree (“K” indicates thousands). The 

















number of knapsack cuts added is the same for KS and KS/ECB solutions, so the information is only recorded once. 
Problems with “INF” in the “Time” column are infeasible in their present form, and require elastic constraints to insure 
feasiblity. 


D. RESULTS FOR REAL-WORLD, ELASTIC GAPS 


Here we investigate computation involving elastic GAPs. In particular, we modify 
the eight real-world GAPs by changing the knapsack constraints to allow penalized viola- 
tion. This can be thought of as allowing the trucks to operate in an overtime status with 
the penalty p;" being the cost of the overtime for truck t. The four real-world problems 
that were infeasible can be solved with the addition of these elastic variables. The elastic 


formulation of the GAP with ECB constraints added 1s: 


minimize >> >> cot®ot + >. PPZy 


0€0 tEeT teT 

subject to: ation ial Vo € O 

fel. 
De cro —z;" Se, Vie T 

o€Or 

LZ ot = aS 0 Ve ae). 

o€Or 
Lot € {0,1} ome OF 
ea ao a, | Vue 2 
Tomer Oe... |Ony vt. Vi © T 


Table 7 shows solution times and the number of branch and bound nodes when each 
technique is applied to the elasticized GAP. Interestingly, the table shows that the problems 


that were feasible and solved without the benefit of elastic constraints (compare with Table 
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Model | BandB_| KS _+| ECB | KSECB_| 
Name 
LORD TST ST BT PST 
Loren | is{ az] anos | af 148 || 2 
-DLWRD | (1000) | (13K) | (1000) | 02K) | 60 [ (1000) [CI37K)| 8.61 | 492. 
DLWRN | 2852] 10441 | 799, 1393] 34] 1.75] 89] 3.10] 65. 


Table 7. Elastic GAP solution results. Time is in CPU seconds. Nodes are the number of nodes in the branch and bound 















enumeration tree. The number of knapsack cuts added is the same for KS and KS/ECB solutions, so the information is 


only recorded once. 


6) were all solved more quickly and with fewer nodes after being elasticized. More impor- 
tantly, problems that were infeasible are now solved. This table, like Table 4, reflects our 
general experience: The combination of ECB and knapsack cuts solves more problems than 


either technique applied in isolation. 


in GAP RESULTS USING NESTED ECB 


Je Nested ECB Without Knapsack Cuts 


We first test nested ECB on problems that cannot be solved by basic ECB, or prob- 
lems that need more than 10000 branch and bound nodes to solve using basic ECB. “Nest 
n” refers to the addition of n nested ECB constraints, one of which is implicit. “SD” refers 
to semi-dynamic nesting which apportions variables to nested constraints using LP solution 
information. In this case, the apportionment is accomplished by solving one LP and apply- 
ing the distance metric described in Chapter V to LP solution values. “Static” implies that 
nesting was carried out by arbitrarily splitting the variables into the appropriate number of 
disjoint subsets, all of roughly the same size. All problems with “GAP” in the model name 
are from the set of randomly generated GAPs. 

The results, shown in Table 8, are varied. GAP11c is solved best by nesting four 


semi-dynamic constraints. GAP 11le solves more quickly using two static nested constraints. 
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See ne 
Name_| Var 
TGAPIic | 500| 98.63 | 23824] 622] 1093| 2810| 7397] 529] 1015. 


Table 8. Nested ECB without knapsack cuts. Time is in CPU seconds. Nodes are the number of nodes in the branch 














and bound enumeration tree. “Var” indicates the number of variables in the problem. An asterisk (*) indicates that the 


problem could not be solved by basic ECB. 


More nesting is not always better as GAP11e demonstrates. GAPAS and DLWRD could not 
be solved by any type of ECB technique, and although GAPC3 was solved by nesting four 
constraints, the basic ECB solution was better. Note that the DLWRD problem (the only 
real-world problem) has the smallest number of variables, yet cannot be solved by any of 


the ECB techniques. 


ee Nested ECB With Knapsack Cuts 


We also test nested ECB combined with knapsack cuts. We select five problems that 
require over 1000 nodes to solve using basic ECB and knapsack cuts. The semi-dynamic 
apportionment is accomplished by recording the number of LP solutions (all solutions ob- 
tained during the cut-generation phase) in which a particular variable was fractional, and 


apportioning variables to the nested constraints based on the “propensity” of the variable 









to be fractional. 
Model 


Table 9. Nested ECB with knapsack cuts. Time is in CPU seconds. Nodes are the number of nodes in the branch and 
















bound enumeration tree. 
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The results, shown in Table 9, are again varied. GAPAS and DLWRD do not benefit 
from nesting having better solution times with knapsack cuts and basic ECB. Semi-dynamic 
nesting with two nested constraints solves GAPC3 most quickly, while semi-dynamic ECB 
with four and static ECB with two nested constraints both solve BOSTD in about 20 CPU 
seconds, quicker than any other solution technique. GAPBS5 solves quickly with both the 
static and semi-dynamic techniques using two nested constraints. In conclusion, we can 
say that nested ECB may be useful for solving certain problems, and sometimes the static 
technique will be better and sometimes the semi-dynamic technique will be. Computational 


testing will be necessary to determine if nesting is of value for a given set of problems. 


FE STRUCTURE-INDEPENDENT RESULTS WITH ECB 


Here we test structure-independent ECB on set-partitioning problems and other 
problems (MIPs) containing binary variables to demonstrate that special structure is not 


required to use ECB successfully. 


de Set-Partitioning Problems and General MIPs 


Set-partitioning problems (SPPs) are difficult IPs to solve and tend to be much larger 
than GAPs. The basic formulation of the SPP is 


minimize ) > ¢;2; 
jeJ 
subject to: > > a2; = I1Vi=1,...,.m 
jeJ 
Ly & tOpedey VIE J, 
where a;; € {0,1}. We implement ECB by using just one ECB constraint that ensures that 


the sum of all the variables in the problem is integer before branching on any individual 
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binary variable. The modified model is: 


minimize > Gay, 


ged 
subject to: > QijZ; — ei — 1s pees tie 
jE 
27% -y = 0 
7€J 
ane Ee {0,1} VgeJ 


Ue eR eile ces FUN 
A MIP can contain continuous, general integer and binary variables. We also test 
ECB on more general MIPs (than the SPP) by adding a single ECB constraint of the form 
a, 4; -y = 0 
jeJ 
aes a Opal I | be 
Here, J is the index set for the binary variables in a problem and y is the added general 


integer branching variable. 


2. ECB Results 


To test structure-independent ECB, we obtained 12 integer problems from the MI- 
PLIB at Rice University (Bixby, et al. 1997) and two SPPs (SETPI1 and PIBOO) from the 
meat-packing industry (Brown, 1997). We decided to use MIPLIB problems that branch 
and bound alone could solve in a reasonable time to a reasonable optimality criterion. We 
allowed 10000 CPU seconds, and solved to an optimality criterion of 0.5%. Results are 


shown in Table 10. 
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Model | Total | Binary | Gen Int ECB 
ee 


T 684, 1608) 75) 37 
SETPZ—[ 2564] 2361 OT 932 | STS 
PiBoo | 377| 377] 0; 6| 39] 6] 4 
Mobos [319] 319, of 141] 3039[ 1.6] 405. 
-CAPGO0OT | 6000] 6000 | __0| 1983.4] 4654 | 120.1 | 776 
MISCO3_[ 160[ 1590] 88) 945 | 141, 1270 
Lis2Lav’ | 1989) 1989] 0 151.7] 3231 | 1569 | 3381 
MISCO6 [1808] 112] of 24] 20] sa] 53. 
TENIGMA [100 100, 0, 15] 337| 1.6] 331 
LSEU——— 89 — a9 | of 529 [2089613 aT 
pooss__ | 33| 33) 0] 6.0] 5806] 7.6] 6081 
Pozo 201[ 201] of 77) 855, 18] 1375, 
DCMULIT| 548.75] 0] 125] 1134, 306 | 1429, 
RGN | 180[ 100] 0] 15.1] 5275] 151] 5232. 
PBELLSA | 133[ 39] 32[ 13.2] 4516] 68[ 2317 


Table 10. Solving binary integer problems with structure-independent ECB. Time is in CPU seconds. Nodes are the 

















number of nodes in the branch and bound enumeration tree. “Var” indicates the number of variables in the problem. SETP2 
is a modification of SETP1 with adjusted penalties for constraint-violation variables. For all those problems marked with 
“+ ” the CPLEX maximum-infeasibility branching strategy was used; that strategy was better than the default. Otherwise, 
the CPLEX default option was used which allows CPLEX to determine the branching strategy. 


ECB helped significantly with SETP1, SETP2, PIBOO, MOD008, CAP6000 and 
BELL3A. L152LAV, ENIGMA, LSEU, P0033 and RGN solved in about the same time and 
number of nodes by both methods. Branch and bound was the better solution option for the 


other four problems. 
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VII. SUMMARY AND RECOMMENDATIONS 


This dissertation has developed enhanced composite enumeration techniques for 
solving IPs and MIPs. Results demonstrate that previously unsolvable problems can be 
solved with these new techniques. This dissertation has specifically examined constraint 
generation from the knapsack polytope and “explicit-constraint branching,” a technique 
that applies constraint branching to IPs and MIPs that do not have the special problem 


structure required by “implicit-constraint branching.” 


A. CONTRIBUTIONS 


1. Knapsack Cuts 


In Chapter III, we developed knapsack cut-finding procedures for minimal cover 
cuts, and converted existing cut-strengthening theory into practical procedures that lift and 
tighten violated minimal cover valid inequalities to violated knapsack facets in polynomial 
time. We defined a new class of knapsack cuts called “non-minimal cover cuts,” cuts that 
do not contain a violated minimal cover cut, developed a dynamic programming procedure 
to find them, and developed a new method, “deficit lifting,” to lift them. Deficit lifting 
enables all non-minimal cover cuts to be lifted and tightened to violated facets as well. 

The minimal cover cut-finding procedure finds a maximally violated minimal cover 
cut, if one exists, in pseudo-polynomial time using dynamic programming. All violated 
minimal cover inequalities are lifted to strong cover cuts by anew procedure called “interior 
lifting.” The procedure that tightens strong cover cuts to violated facets improves upon the 
polynomial-time facet-finding algorithm of Zemel (1989). 

Extensions to knapsack cuts were developed for elastic knapsack constraints and 
non-standard knapsack constraints (those with greater-than-or-equal-to and equality senses). 
Elastic knapsack cuts are generated by an adaptation of the minimal cover cut-finding prob- 


lem of Chapter III. All the procedures of Chapter III were adapted for use with greater-than- 


11] 


or-equal-to and equality knapsack constraints to allow the generation of facets or at least 


strong cuts for these types of constraints. 


Ze Explicit-Constraint Branching 


The method of “explicit-constraint branching” was developed in Chapter V. This 
technique applies constraint branching to MIPs lacking the special structure required by 
standard “implicit-constraint branching” techniques. Explicit-constraint branching alone 
solves some MIPs that branch-and-bound cannot, and nesting the ECB constraints often 
solves more difficult problems. When combined with knapsack cuts, the synergistic effect 


of ECB with knapsack cuts solves still more difficult IPs. 


B. RECOMMENDATIONS FOR FUTURE RESEARCH 


This dissertation developed the new technique of explicit-constraint branching. Fur- 
ther study on nesting strategies and semi-dynamic techniques 1s necessary. ECB may prove 
to be effective (or not) for other classes of problems, and there may be different adaptations 
of ECB that could also prove effective for solving difficult problems. 

Finding violated knapsack facets that are not associated with any minimal or non- 
minimal cover cut is an area that requires further study. There could exist a relatively simple 
dynamic programming technique similar to our minimal cover cut-finding procedure that 
can find these violated facets. 

The implementation of “branch and cut” using easily generated, globally valid knap- 
sack cuts is warranted. In particular, globally valid knapsack cuts that were not apparent 
from the initial LP relaxations may become apparent and could be useful in solving the re- 
stricted problems of the branch and bound. This dynamic constraint generation technique 
could prove to be effective for solving problems such as the generalized assignment prob- 
lem. 

This dissertation has studied cuts based on special structure. We suggest further 
study of structure-independent cutting-plane techniques such as the Chvatal-Gomory round- 


ing method (Chvatal,1973). These cuts have been shown to be useful, but our experience 


ele 


has shown that the methodology can also be computationally burdensome. Since many 
of these techniques have finite (convergent) algorithms associated with them, the develop- 
ment of computationally efficient, structure-independent cutting planes should be explored 


further. 
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APPENDIX. COMPUTATIONAL RESULTS 


This appendix contains detailed results of the randomly generated generalized assignment 
problem. The composite solution algorithm 1s coded in C and uses CPLEX 3.0’s callable 
library to solve linear programming relaxations and to branch and bound on the integer 
program as modified by our solution algorithm. All CPU times reported here are from an 
IBM RS-6000 Model 590 with 512 megabytes of random access memory. We allowed a 


maximum of 1000 CPU seconds with optimality criterion of .5%. 


A. STATISTICS 


The following table provides probelm size information for the 84 GAP problems. 


[ GAPIae | 5 | 15 | 20 | 75 
[GAP3ae [5 | 20 [25 | 100 
GAP3ae_ [5] 25 | 30 ~+Y 125 
[GAPSae | 8 | 24 | 32 ~+| 182 
[GAPéae [| 8 | 32) 40 ~*«| 256 
GAPTae [| 8 | 40 | 48 ~~ ~320_ 
GAPSae | 8 | 4 | 36 | 384 
GAPIIae | 10] 30_| 60 | 300 
GAPI2ae | 10 | 60 | 70 | 600 


Table 11. GAP problem size. The first 60 GAP problems have been used by I. H. Osman, “Heuristics for the Generalised 
Assignment Problem: Simulated Annealing and Tabu Search Approaches," OR Spektrum, Volume 17, 211-225, (1995), 
and D. Cattrysse, M. Salomon and L. N. Van Wassenhove, “A set partitioning heuristic for the generalized assignmnet 
problem," European Journal of Operational Research, Volume 72, 167-174, (1994). The final 24 problems (GAPA1-D6) 
were used by P C. Chu and J. E. Beasley, “A genetic algorithm for the generalised assignment problem,” working paper, 
The Management School, Imperial College, London SW7 2AZ, England (1995). 
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B. RESULTS FOR PROBLEMS WITH LESS THAN 500 VARIABLES 


The first 50 problems presented no challenge for any of the techniques developed in the 
dissertation, to include using only knapsack cuts in conjunction with the branch and bound. 


Note that branch and bound alone could not solve over half of the 50 problems. 





Model 
Name 
GAPIa| 219, 409/198] 24] 16[ 157] 59| 196] 61 
'GAPId| 240[ 388/190] 6| 13] 167] 104197, 15, 
"GAP2d | 49.74 | 37038 | 186] 6] 10/175] 248[ 196, 6 
-GAP3d | 57.43 | 40139[ 2.09[ 8] 19[ 152] 33] 2.16) 8 
GAP3e | 3.18 1741] 221 6] 17] 154] 47[ 227, 6 
'GAP4d| 236 825[263| 8| 27, 155] so, 272| 8 
"GAPde [(1000) | 283K) [2.10] 50] 17/203] 431 [ 2.12, 8 
-GAPSd | 53.02 | 37773[ 183] _O| 12] 1e1] 61] 189) 0} 


Table 12. Problems with less than 500 vartables. 






























hea 


Model 
Name 
“capes [Saas [Toss aaT] ee ae] 20 S| a 
GAPS | 10.78) 61.09 | 188, 0] 11] 156| 38] 195, 0 
[GAP6e | 109.20 | 36435 [2.26] 6] 25] 1.4) 73| 239, 6 
GAP6d | 6598] 33337 2.25] 9] 24| 1.73} 133] 229| 6 
[Gapée | 000) aaek) [2.16 [628 | 206 | 307 | 326 | 
GAP7a | (1000) | (437K) | 247[ 85) 20; 161] 35] 234) 8] 
Gare [tek 196] sft tn sap or 
GAPS | (1000) | (474K) | 214[68| 15] 181) 90, 2.15] 13 
ee ee ar estat 
rGapite [on Genk) 2 ~zi0 as ase er rst ar 
2 
ap 234] 359 2.18] 


Table 13. Problems with less than 500 variables. 


C. RESULTS FOR PROBLEMS WITH 500 AND 600 VARIABLES 
































These problems began to challenge the techniques and the computer memory. Ina few cases 
(GAPA]1 and GAPD1), the time required to generate cuts is significant, causing solution time 
to increase. The large number of nodes required by ECB to solve GAPIllc and GAPIle 
mark them as candidates for nested ECB. GAP12c and GAPD1 are the first two instances 
where the computer terminated the solution process prematurely. In both cases, there was 


insufficient memory to keep the extensive data required by the branch-and-bound process. 


ae 


Model 
Name 
(GAPiia| 17281] 59274] 284] 98] 32] 221] 205] 277, 23) 
3.56 
2.52 
-GAPDI | (737.51) | Q95K)|22.73| 0] 13] 162, 16/2261] 0 


Table 14. Problems with 500 and 600 variables. 


D. RESULTS FOR PROBLEMS WITH 1000 VARIABLES 

















Solving with knapsack cuts and branch and bound becomes increasingly difficult. ECB 
does well with the exception of GAPC3, which it cannot solve, making it a candidate for 
nested ECB. Cut generation time 1s significant, making ECB alone quicker in many cases, 
even when using more nodes in branch and bound. Two problems (GAPD2 and GAPD3) 


terminated early due to an unrecoverable failure during the branch-and-bound process. 


Mode 
Name 
/GAPD2 | (506.52) | (26K) [484.4a[ 8] 29] 184] 20/48271| —*& 
"GAPB3 | (1000) | (261K) | 40.84 5297] 25| 221[ 96] 428] 25 
"GAPD3 [ (805.84) | @07K) | 19.69, 8] 39] 195, 43] 19.75[ 8 


Table 15. Problems with 1000 variables. 
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E. RESULTS FOR PROBLEMS WITH 2000 VARIABLES 


Solving with knapsack cuts and branch and bound becomes still more difficult, and GAPBS 
cannot be solved with knapsack cuts and branch and bound. ECB does well with the excep- 
tion of GAPA5, which ECB cannot solve, and GAPCS, which requires over 20,000 nodes. 
Both are candidates for nested ECB. Again, cut generation time is significant. Two more 
problems (GAPC4 and GAPD5) terminated early due to an unrecoverable failure during the 


branch-and-bound process. 


Model 
GAPAS | (1000) | (147K) | 389.71 | 17879 | 90 | (1000) | (89K) | 293.70 | 9621 


Table 16. Problems with 2000 variables. 









E RESULTS FOR PROBLEMS WITH 4000 VARIABLES 


Solving with knapsack cuts and branch and bound nearly impossible. GAPA6, GAPB6, and 
GAPC6 cannot be solved in 1000 CPU seconds with knapsack cuts. ECB does exceptionally 
well. Knapsack cuts and ECB combined take fewer nodes than ECB alone in every case, 


but more CPU time as cut generation time increases. 


Model KS/ECB 
Name 
"GAPCS | (1000) | (76K) | (1000) | (46K) | 69 | 87.28 | 1244 | 39.09 | 199, 
[GAPD6 | (1000) | (7K) | 47.17] 125[ 62] 421] 109] 4753] 66. 


Table 17. Problems with 4000 variables. 



















These problems are so large that the number of branch-and-bound nodes that can be transited 


I 


in 1000 CPU seconds is much fewer than the mid-sized problems, which possibly explains 


why there were no premature terminations of the solution process for these problems. 


126 


10. 


INITIAL DISTRIBUTION LIST 


Defense Technical Information Center.................ccccccccccccccecccccecceee: 


8725 John J. Klingman Rd., Ste. 0944 
Ft. Belvoir, VA 22060-6218 


By ae UT ra Te A RE a cciSL gon... <4 ...socavincacdsaccececerereececeeeseeecaeeress 


Naval Postgraduate School 
411 Dyer Rd. 
Monterey, CA 93943-5101 


[Drpeiotiardes mm bister Ode Ol oo iics.c.cccccdeccdsccovsscsscdecccassovsvecesceescovsees 


Naval Postgraduate School 
Monterey, CA 93943-5002 


WDE Pete PURAMS COE Oo 2c...ec.c<.c.ccc0ccsicccoccssessscovccsecsoccescovceooscosesees 


Naval Postgraduate School 
Monterey, CA 93943-5002 


Dr. Richard E. Rosenthal Code OR/RI.............. 0c. cece cc eeeceeccceeceeceeees 


Naval Postgraduate Schoo! 
Monterey, CA 93943-5002 


Dipemlwcy mer Codie Ode ORY W di... 2.01.25. c. ieee cceticantcnns.n-cteseceon’s 


Naval Postgraduate School 
Monterey, CA 93943-5002 


Pre G@ierda Gr brown Code OR/ BW. ciiicio.nc.celccceccsnccddeeSeidecevecseseeeeoe 


Naval Postgraduate School 
Monterey, CA 93943-5002 


Die lanes W ashbuin Code ORS WS. co.cc vccscceecoveescnccdscadeeseenses 


Naval Postgraduate School 
Monterey, CA 93943-5002 


Dern ye easmussem (Ode MA/ Ra. <.cceccce scree ceenvenecstevceeeneeneee 


Naval Postgraduate School 
Monterey, CA 93943-5002 


Dr. Francois Melese Code 64/ME.............c..cccscccsccscscescecesceceececececees 


Defense Resources Management Institute 
Naval Postgraduate School 
Monterey, CA 93943-5201 


ae 


No. of Copies 


Ze 


Ie 


ee 


. LTC Jeffrey AvApple cet ce. er 


ATTN: MADN-A 

Department of Mathematical Sciences 
US Military Academy 

West Point, NY 10996-1786 


COL D: C. Amey wii.cn.sc1c:0hekc ee 


ATTN: MADN-A 

Department of Mathematical Sciences 
US Military Academy 

West Point, NY 10996-1786 


COL James L. Kays...c200ca ee 


Department of Systems Engineering 
US Military Academy 
West Point, NY 10996 


, Col Daniel W. Litwhiler:......3.23. ee 


Department of Mathematical Sciences 
2354 Fairchild Dr., Ste. 6D2A 
USAF Academy, CO 80840-6252 


, Academic Research Division .............. 0) 


ATTN: Dr. Stephen Landowne 
US Military Academy 
West Point, NY 10996-5000 


. Professor George B; Dantzig... i015. 


EES & OR Department, MC: 4022 
Terman Engineering Ctr., Rm 418 
Stanford University 

Stanford, CA 94305 


Professor B. Curtis Eaves ..ccicccccccccccesvsscesesesescserecteenn ene 


EES & OR Department, MC: 4022 
Terman Engineering Ctr., Rm 419 
Stanford University 

Stanford, CA 94305 


128 


SCCCSCSCHSSHE SESS SEHSHSEHHEHSHESEH OSE SEH EES 


Pe er lsd aa UE) Senses oe fea sc e-0-.000000tdecsooceevosevecesscnssesesececacccccccccccaccecsesenee 
Sandia National Laboratories 

PO Box 5800 

Albuquerque, NM 87185-1110 


Ne i TNIV OBO A Re eee scdecccesccecssievoseyecesssedetecescececcocooccverssceccccescevscssccees 
Department of Industrial Engineering 

Texas A&M University 

College Station, TX 77843-3131 


Ban PO Nay T0000) esses esass sacs scce000ee2lddeqcseccesasneesccteccuecesccsssccescovaecessenceccoaee 
Engineering Science Dept. 

University of Auckland 

Private Bag 

Auckland, New Zealand 


BD) GaN) AT ct ore TTL) tps ose oes cas cacsccscescovscaceseGeeebescciccéscescaccccccscesccsccsccccoscosceccosce 


Department of Mechanical Engineering 
Engineering Teaching Center 

The University of Texas at Austin 
Austin, TX 78712 


129 





DUDLEY KNOX LIBRARY 
NAVAL FOSTGRADBLE Te “CHOOL 
MONTEREY CA SOU4S-S101 








